-- Logs begin at Mon 2022-08-01 14:38:19 UTC, end at Mon 2022-08-01 15:57:15 UTC. -- Aug 01 15:22:24.884304 dv-cinder-847536-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 01 15:22:24.893827 dv-cinder-847536-3-smb devstack@keystone.service[80427]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:22:24 2022] *** Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: nodename: dv-cinder-847536-3-smb Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: machine: x86_64 Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: clock source: unix Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: pcre jit disabled Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: detected number of CPU cores: 4 Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: current working directory: / Aug 01 15:22:24.895909 dv-cinder-847536-3-smb devstack@keystone.service[80427]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:22:24.896540 dv-cinder-847536-3-smb devstack@keystone.service[80427]: your processes number limit is 47680 Aug 01 15:22:24.896540 dv-cinder-847536-3-smb devstack@keystone.service[80427]: your memory page size is 4096 bytes Aug 01 15:22:24.896540 dv-cinder-847536-3-smb devstack@keystone.service[80427]: detected max file descriptor number: 2048 Aug 01 15:22:24.896540 dv-cinder-847536-3-smb devstack@keystone.service[80427]: lock engine: pthread robust mutexes Aug 01 15:22:24.896540 dv-cinder-847536-3-smb devstack@keystone.service[80427]: thunder lock: enabled Aug 01 15:22:24.896540 dv-cinder-847536-3-smb devstack@keystone.service[80427]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 01 15:22:24.896540 dv-cinder-847536-3-smb devstack@keystone.service[80427]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:22:24.936363 dv-cinder-847536-3-smb devstack@keystone.service[80427]: Python main interpreter initialized at 0x55fe964399c0 Aug 01 15:22:24.936363 dv-cinder-847536-3-smb devstack@keystone.service[80427]: python threads support enabled Aug 01 15:22:24.936363 dv-cinder-847536-3-smb devstack@keystone.service[80427]: your server socket listen backlog is limited to 100 connections Aug 01 15:22:24.936363 dv-cinder-847536-3-smb devstack@keystone.service[80427]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:22:24.936731 dv-cinder-847536-3-smb devstack@keystone.service[80427]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:22:24.936806 dv-cinder-847536-3-smb devstack@keystone.service[80427]: *** Operational MODE: preforking *** Aug 01 15:22:24.937052 dv-cinder-847536-3-smb devstack@keystone.service[80427]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:22:24.937052 dv-cinder-847536-3-smb devstack@keystone.service[80427]: spawned uWSGI master process (pid: 80427) Aug 01 15:22:24.937251 dv-cinder-847536-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 01 15:22:24.938304 dv-cinder-847536-3-smb devstack@keystone.service[80427]: spawned uWSGI worker 1 (pid: 80434, cores: 1) Aug 01 15:22:24.938304 dv-cinder-847536-3-smb devstack@keystone.service[80427]: spawned uWSGI worker 2 (pid: 80435, cores: 1) Aug 01 15:22:24.938304 dv-cinder-847536-3-smb devstack@keystone.service[80427]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:22:30.537332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:22:30.537332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: from cryptography.utils import int_from_bytes Aug 01 15:22:30.538134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:22:30.538134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: from cryptography.utils import int_from_bytes Aug 01 15:22:30.550201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:22:30.550201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: from cryptography.utils import int_from_bytes Aug 01 15:22:30.550743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:22:30.550743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: from cryptography.utils import int_from_bytes Aug 01 15:22:30.589482 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:22:30.589686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:22:30.589841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] command line args: [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:22:30.590115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:22:30.590293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ================================================================================ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:22:30.590548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] admin_token = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.590798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] config_dir = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.591083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.591168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] config_source = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.591343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] debug = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.591568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.591945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.592129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.592386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.592638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.592872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.593055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_config_append = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.593237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.593418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_dir = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.593596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.593850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.594087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.594339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.594585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.594765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.594945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.595192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.595469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.595716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.596047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.596286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.596522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.596773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.597086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.597313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.597834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.598020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] publish_errors = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.598256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.598492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.598686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.598907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.599144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.599399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] standard_threads = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.599642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.599888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.600066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.600243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_journal = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.600421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_json = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.600597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_stderr = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.600774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_syslog = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.601007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.601267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.601508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.601770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.602012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.602130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:22:30.602913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.603097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:22:30.603272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.603464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] command line args: [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:22:30.603643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.603809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:22:30.603809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ================================================================================ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:22:30.604099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.604217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] admin_token = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.604327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.604327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.604548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] config_dir = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.604672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.604791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.604906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.605017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] config_source = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.605017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] debug = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.605229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.605340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.605476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.605586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.605703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.605814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.605930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.606041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.606170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.606282 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.606401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.606513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.606513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] log_config_append = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.606724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.606835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.606944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.607237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] log_dir = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.607355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.607502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] log_file = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.607615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.607725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.607725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.607940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.608057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.608167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.608282 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.608395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.608504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.608623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.608740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.608863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.608980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.609096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.609217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.609329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.609445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.609555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.609664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.609773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.609891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.610001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.610111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.610225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.610225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.610437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.610563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.610563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.610776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.610886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.610886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.611098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.611217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.611217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.611217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.611538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.611649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.611770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] publish_errors = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.612029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.612176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.612291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.612403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.612589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.612703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.612819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.612929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.613040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.613201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.613325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.613438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.613651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] standard_threads = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.613776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.613894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.614004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.614126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.614238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.614354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.614465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.614574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] use_journal = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.614689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.614808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] use_json = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.614918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.615034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] use_stderr = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.615145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.615328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] use_syslog = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.615478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.615588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:30.615700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.615816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.615932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.616953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.617071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.617184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.617295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.617404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.617514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.617699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.617813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.617928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.618943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.619061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.619173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.619322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.619451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.619562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.619684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.619802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.619914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.620924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.621041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.621153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.621262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.621372 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.621492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.621633 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.621757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.621984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622379 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622482 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.622967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.623068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.623180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.623284 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.623423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.623540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.623651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.623763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.623942 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.624064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.624177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.624287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.624405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.624517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.624640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.624752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.624869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.625914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626373 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.external = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.626925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.password = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.token = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.627975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.628097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.628210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.628321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.628431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.628542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.628652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.628771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.628889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629567 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.629900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.630010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.630196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.630324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.630444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.630557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.630676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.630792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.630904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.631132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.631256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.631256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.631545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.631545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.631756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.631880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.632903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.633958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.634084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.634205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.634205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.634425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.634538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.634659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.634772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.634891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.635134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.635256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.635414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.635535 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.635702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.635832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.636061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.636315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.636464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.636579 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.636777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.636903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.637046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.637195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.637311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.637525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.637640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.637764 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.638004 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.638121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.638308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.638428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.638549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.638670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.638784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.638897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.639009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.639121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.639235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.639356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.639494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.639672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.639800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.639915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.640953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.external = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.641975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.642087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.642207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.642321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.642434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.642546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.642732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.642854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.password = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.642977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.643093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.token = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.643204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.643318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.643502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.643639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.643755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.643868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.643991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.644104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.644216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.644404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.644522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.644635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.644747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.644860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.644972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.645093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.645212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.645326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.645438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.645552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.645665 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.645785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.645899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.646011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.646129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.646248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.646369 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.646494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.646708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.646826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.646939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.647052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.647165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.647481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.647600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.647714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.647827 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.647939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.648969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.649653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.649773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.649886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.649998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.650124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.650242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.650355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.650467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.650579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.650690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.650811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.650925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.651847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.652961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.653171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.653289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.653402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.653523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.653636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.653748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.653860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.653972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654652 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654764 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.654997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.655110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.655221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.655334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.655461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.655585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.655700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.655813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.655924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.656036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.656159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.656272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.656384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.656605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.656723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.656835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.656955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.657980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.658092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.658203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.658322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.658436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.658547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.658658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.658776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.658888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.659007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.659007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.659219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.659331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.659331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.659665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.659791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.659912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] role.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] role.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.660998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.661116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.661386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.661504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.661618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.661731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.661843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.661955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.662155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.662273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.662422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.662579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.662730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.662891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.663014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.663129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.663355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.663507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.663668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.663785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.664157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.664328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.664447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.664646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.665311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.665441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.665600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.665718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.665830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.665942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.666975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.667087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.667199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.667312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.667443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.667571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.667687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.667799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.667918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.668036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.668150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.668270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.668383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.668495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.668609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.668705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.668818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.669005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.669122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.669321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.669440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.669552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.669666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.669786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.669901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.670925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.671037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.671157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.671270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.671417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.671534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.671646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.671760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.671888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.672003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.672115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.672227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.672338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.672450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.672732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.672849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.672961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.673968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.674092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.674217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.674330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.674507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.674507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.674719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.674831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.674952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.675066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.675178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.675290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.675465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.675597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.675724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.675838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.675952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676751 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.676976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.677937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] role.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.678032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.678032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:22:30.678206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] role.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.678206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.678429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.678555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.678807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.679056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.679306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.679599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.679829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.680077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.680353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.680606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.680855 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.681105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.681475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.681801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.682089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.682344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.682597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.682849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.683103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.683458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.683717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.684078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.684508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.684938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.685370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.685743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.686088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.686488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.686631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.686948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.687463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.687800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.688233 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] token.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.688604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.688943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.689196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.689464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.689724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.690063 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.690227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.690481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.690737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.690983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.691223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.691488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.691741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.692001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.692234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.692482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.692779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.693044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.693292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.693546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.693788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.694028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.694292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.694651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.694946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.695129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.695514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.695852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.696038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.696403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.696667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.697025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.697283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.697595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.697886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.698137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:30.698421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:22:30.707761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.707995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.708226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.717669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.726996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.727290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.728059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.736720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.748940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.749190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.758348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.758607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.803233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.805562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.855496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.855762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.863640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.864001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.923563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.923824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.924001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.924224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.924446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.924574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.924695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.924813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.924928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.925097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.925358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.925625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.948846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.949109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.949329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.949549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.949750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.949954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.950147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.950347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.950563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.950563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.950940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.950940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.951342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.951342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.961457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.961723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.974861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.975142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.975316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.975539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.975742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.975956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.976172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.976293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.976422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.976632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.976856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.977075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.977833 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.978055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:22:30.994247 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.994461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:22:30.994789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.994996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:22:30.995409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.995632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.995831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.995831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:22:30.996174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.996174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.996516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.996516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:22:30.996923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.997348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.997805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:30.998130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.005844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.006126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.006400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.006686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.008104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.008407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.008691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.008978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.013668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.015964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.018469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.018755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.019039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.019322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.019631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.019897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.020174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.020445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.020712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.020850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.020983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.021130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.021274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.021391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.021562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.021846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.022108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.022375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.022647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.022987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.023283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.023583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.045006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.046515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.046801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.049659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.051454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.051790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.051915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.052123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.052241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.057473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.057701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.057992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.060001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.060290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.064381 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.064667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.064810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.064956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.065079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.065242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.065521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.065799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.066073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.066346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.069240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.069541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.069826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.070110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.070387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.070674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.070986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.071274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.082168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.082473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.086356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.089349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.089528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.089679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.089826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.093579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.094201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.096784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.097123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.097515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.100771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.101071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.101358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.101648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.101930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.102751 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.104327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.107586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.110845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.111148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.111463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.111753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.112034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.112331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.119412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.119706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.119980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.120246 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.127114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.128808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.129089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.130846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.131134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.131437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.131748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.131947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.132221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.132523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.132816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.133102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.138688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.140265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.140542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.143337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.143640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.143943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.144229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.144526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.144648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.144880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.145167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.145447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.145727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.146000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.146275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.158000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.158287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.158575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.158856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.159134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.159429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.159719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.161904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.165687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.168656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.171300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.172812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.173101 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.173390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.176216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.179857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.181092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.182027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.184537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.185065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.185361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.185651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.185942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.187168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.188819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.189118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.189435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.193995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.194288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.194572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.195957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.197576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.200527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.200817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.201101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.201393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.201567 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.201851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.202132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.202410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.202690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.202969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.203253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.203547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.203921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.204203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.204488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.204753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.205035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.205296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.210780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.211243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.211784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.218831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:22:31.219113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.219419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.219705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.220002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.220281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.220568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.220850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.221491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.221491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.221783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.222064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.222345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.222663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:22:31.239920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fe964399c0 pid: 80435 (default app) Aug 01 15:22:31.244142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b90f9-a3e3-48de-9182-af5ef9ab61d5 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:31.244435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b90f9-a3e3-48de-9182-af5ef9ab61d5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:31.244713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b90f9-a3e3-48de-9182-af5ef9ab61d5 None None] PATH_INFO: `/v3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:31.249072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Mon Aug 1 15:22:31 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:31.263730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fe964399c0 pid: 80434 (default app) Aug 01 15:22:39.004754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8b3c-4f5d-4f6e-8e64-d2a53b5bd6df None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:39.005325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8b3c-4f5d-4f6e-8e64-d2a53b5bd6df None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:39.005325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8b3c-4f5d-4f6e-8e64-d2a53b5bd6df None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:39.006624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:39.014734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:39.015170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:39.015301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:39.086728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: INFO dbcounter [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] Registered counter for database keystone Aug 01 15:22:39.106399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG oslo_db.sqlalchemy.engines [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:39.111817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writer thread running {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:39.293621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG passlib.handlers.bcrypt [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80434) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 15:22:39.294040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG passlib.handlers.bcrypt [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80434) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 15:22:39.348654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:39.350260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:39.483522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1/3] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 15:22:39.632189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8b3c-4f5d-4f6e-8e64-d2a53b5bd6df None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:39.702885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: INFO dbcounter [None req-4d8a8b3c-4f5d-4f6e-8e64-d2a53b5bd6df None None] Registered counter for database keystone Aug 01 15:22:39.724088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG oslo_db.sqlalchemy.engines [None req-4d8a8b3c-4f5d-4f6e-8e64-d2a53b5bd6df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:39.730318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writer thread running {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:39.848592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8b3c-4f5d-4f6e-8e64-d2a53b5bd6df None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:39.853811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d10ce-c6d4-4209-9e2c-c060e7bc3f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:39.854443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d10ce-c6d4-4209-9e2c-c060e7bc3f4d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:39.854726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d10ce-c6d4-4209-9e2c-c060e7bc3f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:39.854998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d10ce-c6d4-4209-9e2c-c060e7bc3f4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:39.863411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d10ce-c6d4-4209-9e2c-c060e7bc3f4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:39.916755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d62d10ce-c6d4-4209-9e2c-c060e7bc3f4d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 15:22:39.917029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d10ce-c6d4-4209-9e2c-c060e7bc3f4d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:39.926986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 3/4] 10.222.0.71 () {58 vars in 1324 bytes} [Mon Aug 1 15:22:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:22:39.932967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:39.947962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c3da-2b0d-4dfe-940e-5693a8d396b6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:39.952409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56561d7b-4260-4a32-b91e-9800f06d7fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:39.953556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56561d7b-4260-4a32-b91e-9800f06d7fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:39.953845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56561d7b-4260-4a32-b91e-9800f06d7fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:39.954827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56561d7b-4260-4a32-b91e-9800f06d7fa5 admin admin] PATH_INFO: `/v3/projects/ffae11e17dfb4f79b4af936d03276821` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:39.956454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56561d7b-4260-4a32-b91e-9800f06d7fa5 admin admin] RBAC: Authorizing `identity:get_project(project_id=ffae11e17dfb4f79b4af936d03276821)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:40.008873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING keystone.common.rbac_enforcer.enforcer [None req-56561d7b-4260-4a32-b91e-9800f06d7fa5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 15:22:40.009215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56561d7b-4260-4a32-b91e-9800f06d7fa5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:40.013990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 2/5] 10.222.0.71 () {56 vars in 1207 bytes} [Mon Aug 1 15:22:39 2022] GET /identity/v3/projects/ffae11e17dfb4f79b4af936d03276821 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:41.971013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3c97-0eeb-44c1-9165-31583870c47c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:41.971549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3c97-0eeb-44c1-9165-31583870c47c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:41.971800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3c97-0eeb-44c1-9165-31583870c47c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:41.975664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 4/6] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:22:41.981914 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8cd8-e375-46c6-a94b-fa0d7464b68d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:41.982615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8cd8-e375-46c6-a94b-fa0d7464b68d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:41.982615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8cd8-e375-46c6-a94b-fa0d7464b68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:42.010194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-af9d8cd8-e375-46c6-a94b-fa0d7464b68d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:42.011764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-af9d8cd8-e375-46c6-a94b-fa0d7464b68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:42.019834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 3/7] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 15:22:42.042905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3c97-0eeb-44c1-9165-31583870c47c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:42.055705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3c97-0eeb-44c1-9165-31583870c47c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:42.059807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665cd9a-a574-49d4-a66f-776ea9ff4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:42.060422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cd9a-a574-49d4-a66f-776ea9ff4ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:42.060703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cd9a-a574-49d4-a66f-776ea9ff4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:42.060975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cd9a-a574-49d4-a66f-776ea9ff4ca6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:42.068809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665cd9a-a574-49d4-a66f-776ea9ff4ca6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:42.070573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665cd9a-a574-49d4-a66f-776ea9ff4ca6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:42.079760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 5/8] 10.222.0.71 () {58 vars in 1324 bytes} [Mon Aug 1 15:22:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:22:42.085822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d8cd8-e375-46c6-a94b-fa0d7464b68d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:42.096098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d8cd8-e375-46c6-a94b-fa0d7464b68d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:42.100793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf499843-717a-46da-8a75-bd9e67b1398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:42.101434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499843-717a-46da-8a75-bd9e67b1398f admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:42.101718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499843-717a-46da-8a75-bd9e67b1398f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:42.102701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499843-717a-46da-8a75-bd9e67b1398f admin admin] PATH_INFO: `/v3/users/4dac00d0ca0d4081a88ccba053ac2218` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:42.104119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf499843-717a-46da-8a75-bd9e67b1398f admin admin] RBAC: Authorizing `identity:get_user(user_id=4dac00d0ca0d4081a88ccba053ac2218)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:42.105960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf499843-717a-46da-8a75-bd9e67b1398f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:42.107957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 4/9] 10.222.0.71 () {56 vars in 1198 bytes} [Mon Aug 1 15:22:42 2022] GET /identity/v3/users/4dac00d0ca0d4081a88ccba053ac2218 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:44.163596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2db24-9bef-4631-b61d-a7b08dba92dd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.164409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2db24-9bef-4631-b61d-a7b08dba92dd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.164409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2db24-9bef-4631-b61d-a7b08dba92dd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.165753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:44.171003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5364b9-749e-432d-867b-b02c942819ba None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.171467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5364b9-749e-432d-867b-b02c942819ba None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.171593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5364b9-749e-432d-867b-b02c942819ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.192248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8d5364b9-749e-432d-867b-b02c942819ba None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:44.193334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8d5364b9-749e-432d-867b-b02c942819ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:44.204545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0502b-2b1a-4b6f-ab09-2c551bbe8413 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.204828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0502b-2b1a-4b6f-ab09-2c551bbe8413 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.205100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0502b-2b1a-4b6f-ab09-2c551bbe8413 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.206432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 7/11] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:22:44.211567 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.211856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.212132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.254861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG passlib.handlers.bcrypt [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80435) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 15:22:44.255330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG passlib.handlers.bcrypt [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80435) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 15:22:44.278085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 5/12] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:22:44.301258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:44.301424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5364b9-749e-432d-867b-b02c942819ba None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:44.302865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:44.329794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:44.405724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 8/13] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:22:44.413238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5364b9-749e-432d-867b-b02c942819ba None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:44.427931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:44.449288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6287a2-b6dc-4059-aa84-0b380e3fb3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:44.449948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6287a2-b6dc-4059-aa84-0b380e3fb3fb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.450231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6287a2-b6dc-4059-aa84-0b380e3fb3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.450507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6287a2-b6dc-4059-aa84-0b380e3fb3fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.462042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6287a2-b6dc-4059-aa84-0b380e3fb3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7c6287a2-b6dc-4059-aa84-0b380e3fb3fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:22:44.470971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:44.472352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:22:44.473387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 6/14] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:22:44.480592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6287a2-b6dc-4059-aa84-0b380e3fb3fb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:44.528889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f12d92-67eb-4c46-bdb7-c4979d31b155 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:44.531198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:44.565734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:44.567300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d1595-6224-4eb2-88a6-c89030fb0055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:44.568217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1595-6224-4eb2-88a6-c89030fb0055 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.568614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1595-6224-4eb2-88a6-c89030fb0055 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.568785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1595-6224-4eb2-88a6-c89030fb0055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.584874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6287a2-b6dc-4059-aa84-0b380e3fb3fb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:44.619722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:44.620346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.620625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.620898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.621616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:44.621923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:44.623327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:44.636431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 7/15] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:22:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:22:44.637034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d1595-6224-4eb2-88a6-c89030fb0055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:44.638617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d1595-6224-4eb2-88a6-c89030fb0055 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:44.642099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:44.749871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 9/16] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:44.755649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d1595-6224-4eb2-88a6-c89030fb0055 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:44.758849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:44.852860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76dce7-f715-4a28-a33b-512dbb39706b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:44.863971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d1595-6224-4eb2-88a6-c89030fb0055 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:44.886715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25952450-ec01-4ab6-8353-beca97a07028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:44.887366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25952450-ec01-4ab6-8353-beca97a07028 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.887679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25952450-ec01-4ab6-8353-beca97a07028 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.887958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25952450-ec01-4ab6-8353-beca97a07028 None admin] PATH_INFO: `/v3/users/4dac00d0ca0d4081a88ccba053ac2218` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.889138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25952450-ec01-4ab6-8353-beca97a07028 None admin] RBAC: Authorizing `identity:get_user(user_id=4dac00d0ca0d4081a88ccba053ac2218)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:44.890619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25952450-ec01-4ab6-8353-beca97a07028 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:44.892251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 8/17] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:22:44 2022] GET /identity/v3/users/4dac00d0ca0d4081a88ccba053ac2218 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:22:44.897785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25952450-ec01-4ab6-8353-beca97a07028 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:44.899846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:44.900723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:44.901010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:44.901286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:44.913157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:44.920693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:44.922286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:22:44.940215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:44.941130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:44.942139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:22:44.942139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:22:44.942139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:22:44.942139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:22:44.942139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 10/18] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:22:44.948160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:45.003288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25952450-ec01-4ab6-8353-beca97a07028 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:45.008104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:45.043489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17ae8-4243-41b5-819e-dc65200deb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:45.044146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17ae8-4243-41b5-819e-dc65200deb4a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:45.044423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17ae8-4243-41b5-819e-dc65200deb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:45.044701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17ae8-4243-41b5-819e-dc65200deb4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:45.045887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a17ae8-4243-41b5-819e-dc65200deb4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:45.047413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a17ae8-4243-41b5-819e-dc65200deb4a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:45.049226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 9/19] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:22:45.054826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17ae8-4243-41b5-819e-dc65200deb4a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:45.061709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7c31-d152-4cdf-bf1a-800998de2235 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:45.095941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f9ab1-f013-4e11-8c22-b381f7287e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:45.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f9ab1-f013-4e11-8c22-b381f7287e0c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:45.096849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f9ab1-f013-4e11-8c22-b381f7287e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:45.097124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f9ab1-f013-4e11-8c22-b381f7287e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:45.097811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f9ab1-f013-4e11-8c22-b381f7287e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:45.098117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f9ab1-f013-4e11-8c22-b381f7287e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:45.099539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f9ab1-f013-4e11-8c22-b381f7287e0c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:45.117084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:22:45.140090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:45.163602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17ae8-4243-41b5-819e-dc65200deb4a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:45.202210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db936a58-7273-49bf-bed8-1e58341debf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:45.202882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936a58-7273-49bf-bed8-1e58341debf4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:45.203129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936a58-7273-49bf-bed8-1e58341debf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:45.203431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936a58-7273-49bf-bed8-1e58341debf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:45.204241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db936a58-7273-49bf-bed8-1e58341debf4 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.domain.id=default, user.id=4dac00d0ca0d4081a88ccba053ac2218) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:45.204558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db936a58-7273-49bf-bed8-1e58341debf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:45.206048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db936a58-7273-49bf-bed8-1e58341debf4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:45.214232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1322 bytes} [Mon Aug 1 15:22:45 2022] GET /identity/v3/role_assignments?user.id=4dac00d0ca0d4081a88ccba053ac2218&scope.domain.id=default&role.id=7a7079c0864e4bb7acaa71238097426e => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:22:47.624598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43464-474e-4e5f-996b-c7302ec66b84 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:47.624598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43464-474e-4e5f-996b-c7302ec66b84 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:47.624598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43464-474e-4e5f-996b-c7302ec66b84 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:47.624598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:47.630438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e129f1-072f-4fca-8661-e2120b837cd6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:47.630852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e129f1-072f-4fca-8661-e2120b837cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:47.631030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e129f1-072f-4fca-8661-e2120b837cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:47.660572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-13e129f1-072f-4fca-8661-e2120b837cd6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:47.661808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-13e129f1-072f-4fca-8661-e2120b837cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:47.747923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:47.780896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de43464-474e-4e5f-996b-c7302ec66b84 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:47.834231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd01e-7725-4d75-97b7-f74b7d1ed150 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:47.834950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd01e-7725-4d75-97b7-f74b7d1ed150 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:47.835521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd01e-7725-4d75-97b7-f74b7d1ed150 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:47.837826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 12/24] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:22:47.844022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6cad3-cd44-432a-a4d2-73cdb4178ce4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:47.844578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6cad3-cd44-432a-a4d2-73cdb4178ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:47.845111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6cad3-cd44-432a-a4d2-73cdb4178ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:47.866741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c1e6cad3-cd44-432a-a4d2-73cdb4178ce4 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:47.868930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c1e6cad3-cd44-432a-a4d2-73cdb4178ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:47.988870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de43464-474e-4e5f-996b-c7302ec66b84 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:48.007696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 13/25] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:48.009488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6222-4c89-4874-8a16-f2ab566ff12c None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.010075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6222-4c89-4874-8a16-f2ab566ff12c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.010547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6222-4c89-4874-8a16-f2ab566ff12c None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.012028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 14/26] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:48.016365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:48.019042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39708-fb66-428c-9afb-e08ef95f8c23 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.019590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39708-fb66-428c-9afb-e08ef95f8c23 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.020091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39708-fb66-428c-9afb-e08ef95f8c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.029131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:48.041590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f6e39708-fb66-428c-9afb-e08ef95f8c23 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:48.043123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f6e39708-fb66-428c-9afb-e08ef95f8c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:48.075960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72d1de-981f-47b7-93d7-e00f39705961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:48.076899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72d1de-981f-47b7-93d7-e00f39705961 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.077335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72d1de-981f-47b7-93d7-e00f39705961 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.077815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72d1de-981f-47b7-93d7-e00f39705961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.096126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72d1de-981f-47b7-93d7-e00f39705961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4f72d1de-981f-47b7-93d7-e00f39705961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:22:48.103938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:48.104817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:22:48.105527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:22:48.108154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 13/27] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:22:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:22:48.109149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72d1de-981f-47b7-93d7-e00f39705961 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:48.162351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 15/28] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:48.163850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39708-fb66-428c-9afb-e08ef95f8c23 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:48.286199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72d1de-981f-47b7-93d7-e00f39705961 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:48.309182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39708-fb66-428c-9afb-e08ef95f8c23 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:48.339871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b10d3-af3b-4d23-a689-69d1bf65699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:48.341122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b10d3-af3b-4d23-a689-69d1bf65699e None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.341666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b10d3-af3b-4d23-a689-69d1bf65699e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.342270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b10d3-af3b-4d23-a689-69d1bf65699e None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.343817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b10d3-af3b-4d23-a689-69d1bf65699e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:48.345447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b10d3-af3b-4d23-a689-69d1bf65699e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:48.347634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:48.348469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.348889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.349299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.350158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:48.350617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:48.352195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:48.355536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:48.363858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 16/29] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:22:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:48.365085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:48.493180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e42b3-a7b0-4a53-b41d-3bd6bf35f78f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:48.530789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b31af4-b5bc-40f5-9305-67dede6faec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:48.531796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31af4-b5bc-40f5-9305-67dede6faec1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.532223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31af4-b5bc-40f5-9305-67dede6faec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.532648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31af4-b5bc-40f5-9305-67dede6faec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.544311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b31af4-b5bc-40f5-9305-67dede6faec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:48.546149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b31af4-b5bc-40f5-9305-67dede6faec1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c3b31af4-b5bc-40f5-9305-67dede6faec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:22:48.563102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:48.563964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:48.564821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:22:48.564821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:22:48.564821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:22:48.564821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:22:48.566736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 17/30] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:22:48.568245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b533b6-0dae-42f9-8d75-a2e858979abf None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.568722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b533b6-0dae-42f9-8d75-a2e858979abf None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.569173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b533b6-0dae-42f9-8d75-a2e858979abf None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.570650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 18/31] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:48.572153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b533b6-0dae-42f9-8d75-a2e858979abf None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:48.606777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 14/32] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Aug 1 15:22:48 2022] POST /identity/v3/roles => generated 219 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:22:48.608763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dec02-f31a-4e6a-b1b6-4728399126a6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.609302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dec02-f31a-4e6a-b1b6-4728399126a6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.609752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dec02-f31a-4e6a-b1b6-4728399126a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.632017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-676dec02-f31a-4e6a-b1b6-4728399126a6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:48.634458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-676dec02-f31a-4e6a-b1b6-4728399126a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:48.651876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:48.675116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:48.717141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b533b6-0dae-42f9-8d75-a2e858979abf None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:48.780693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 15/33] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:48.784392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dec02-f31a-4e6a-b1b6-4728399126a6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:48.809560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441791a-6ac8-41ec-9ffb-14e04d6f60b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:48.810263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441791a-6ac8-41ec-9ffb-14e04d6f60b6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:48.810549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441791a-6ac8-41ec-9ffb-14e04d6f60b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:48.810830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441791a-6ac8-41ec-9ffb-14e04d6f60b6 None admin] PATH_INFO: `/v3/users/4dac00d0ca0d4081a88ccba053ac2218` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:48.816243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441791a-6ac8-41ec-9ffb-14e04d6f60b6 None admin] RBAC: Authorizing `identity:get_user(user_id=4dac00d0ca0d4081a88ccba053ac2218)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:48.821957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441791a-6ac8-41ec-9ffb-14e04d6f60b6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:48.824081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 19/34] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:22:48 2022] GET /identity/v3/users/4dac00d0ca0d4081a88ccba053ac2218 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:48.827125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441791a-6ac8-41ec-9ffb-14e04d6f60b6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:48.954338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dec02-f31a-4e6a-b1b6-4728399126a6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:48.969071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441791a-6ac8-41ec-9ffb-14e04d6f60b6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:48.996454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:49.002661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:49.003849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.004176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.004459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.005898 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:49.006212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:49.007826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:49.020430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1509-524d-4cc7-ba62-630c9ff3ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:49.021075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1509-524d-4cc7-ba62-630c9ff3ca99 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.021360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1509-524d-4cc7-ba62-630c9ff3ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.021637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1509-524d-4cc7-ba62-630c9ff3ca99 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.022461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1509-524d-4cc7-ba62-630c9ff3ca99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:49.022709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 16/35] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:49.023930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:49.024127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1509-524d-4cc7-ba62-630c9ff3ca99 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:49.061411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:49.141920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c3bd-cd50-45f9-ab4b-227cfd0784b8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:49.152698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 20/36] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Aug 1 15:22:48 2022] POST /identity/v3/roles => generated 225 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:22:49.153989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b244f-3df5-4678-b3da-5618d3e1a371 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.154286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b244f-3df5-4678-b3da-5618d3e1a371 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.154626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b244f-3df5-4678-b3da-5618d3e1a371 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.160937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 21/37] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:49.160937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b244f-3df5-4678-b3da-5618d3e1a371 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:49.191002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00e426-1263-4c7f-9fb8-5c4505c7dfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:49.192174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e426-1263-4c7f-9fb8-5c4505c7dfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.192658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e426-1263-4c7f-9fb8-5c4505c7dfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.193131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e426-1263-4c7f-9fb8-5c4505c7dfd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.194937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00e426-1263-4c7f-9fb8-5c4505c7dfd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:49.196868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00e426-1263-4c7f-9fb8-5c4505c7dfd3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:49.199154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 17/38] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:49.200692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cd3ab-d7e7-464b-b160-328229be6782 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.201195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cd3ab-d7e7-464b-b160-328229be6782 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.201782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cd3ab-d7e7-464b-b160-328229be6782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.223334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-667cd3ab-d7e7-464b-b160-328229be6782 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:49.225014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-667cd3ab-d7e7-464b-b160-328229be6782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:49.277517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b244f-3df5-4678-b3da-5618d3e1a371 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:49.318507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247f282-f0b6-4f94-ba27-1561455fbe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:49.319072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247f282-f0b6-4f94-ba27-1561455fbe9f None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.319361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247f282-f0b6-4f94-ba27-1561455fbe9f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.319682 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247f282-f0b6-4f94-ba27-1561455fbe9f None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.320395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 18/39] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:49.321465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cd3ab-d7e7-464b-b160-328229be6782 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:49.329902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247f282-f0b6-4f94-ba27-1561455fbe9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:49.333353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247f282-f0b6-4f94-ba27-1561455fbe9f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:49.370636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:49.385934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 22/40] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:22:49 2022] POST /identity/v3/projects => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:22:49.386948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247f282-f0b6-4f94-ba27-1561455fbe9f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:49.432757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:49.494068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cd3ab-d7e7-464b-b160-328229be6782 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:49.537700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247f282-f0b6-4f94-ba27-1561455fbe9f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:49.542036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037687c1-5aae-469d-964f-40d9698a5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:49.542740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037687c1-5aae-469d-964f-40d9698a5fde None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.543027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037687c1-5aae-469d-964f-40d9698a5fde None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.543309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037687c1-5aae-469d-964f-40d9698a5fde None admin] PATH_INFO: `/v3/domains/default/users/4dac00d0ca0d4081a88ccba053ac2218/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.545645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037687c1-5aae-469d-964f-40d9698a5fde None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4dac00d0ca0d4081a88ccba053ac2218, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:49.547424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037687c1-5aae-469d-964f-40d9698a5fde None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:49.567302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 19/41] 10.222.0.71 () {58 vars in 1361 bytes} [Mon Aug 1 15:22:49 2022] PUT /identity/v3/domains/default/users/4dac00d0ca0d4081a88ccba053ac2218/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:22:49.568666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b87a-a212-4897-bc83-1abbf19f5d84 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.568902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b87a-a212-4897-bc83-1abbf19f5d84 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.569179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b87a-a212-4897-bc83-1abbf19f5d84 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.571419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 20/42] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:49.578056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b42e-6662-47ed-b14f-66af34655d64 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.578518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b42e-6662-47ed-b14f-66af34655d64 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.579003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b42e-6662-47ed-b14f-66af34655d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.594782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76228a1c-a6d6-45b0-bedc-4b1dfab2fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:49.595481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228a1c-a6d6-45b0-bedc-4b1dfab2fd4f None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.595773 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228a1c-a6d6-45b0-bedc-4b1dfab2fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.596057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228a1c-a6d6-45b0-bedc-4b1dfab2fd4f None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.596808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76228a1c-a6d6-45b0-bedc-4b1dfab2fd4f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:49.598346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76228a1c-a6d6-45b0-bedc-4b1dfab2fd4f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:49.607323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3f33b42e-6662-47ed-b14f-66af34655d64 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:49.609447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3f33b42e-6662-47ed-b14f-66af34655d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:49.621834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 23/43] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Aug 1 15:22:49 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:22:49.706232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 21/44] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:22:49.731683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76228a1c-a6d6-45b0-bedc-4b1dfab2fd4f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:49.845183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:49.861585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76228a1c-a6d6-45b0-bedc-4b1dfab2fd4f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:49.905206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c140ee-902d-4cd9-b06b-732f89533437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:49.905869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c140ee-902d-4cd9-b06b-732f89533437 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:49.906150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c140ee-902d-4cd9-b06b-732f89533437 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:49.906428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c140ee-902d-4cd9-b06b-732f89533437 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:49.908004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c140ee-902d-4cd9-b06b-732f89533437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:49.909977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c140ee-902d-4cd9-b06b-732f89533437 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:49.911645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 24/45] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:49.918095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33b42e-6662-47ed-b14f-66af34655d64 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:49.934087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:50.024612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33b42e-6662-47ed-b14f-66af34655d64 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:50.061525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601c0b6-5f8d-4017-9a56-297cce1f6e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:50.062167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c0b6-5f8d-4017-9a56-297cce1f6e61 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:50.062455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c0b6-5f8d-4017-9a56-297cce1f6e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:50.062735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c0b6-5f8d-4017-9a56-297cce1f6e61 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:50.063455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601c0b6-5f8d-4017-9a56-297cce1f6e61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:50.064931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601c0b6-5f8d-4017-9a56-297cce1f6e61 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:50.101535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 22/46] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:22:49 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:22:51.624463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fb53-baf6-45b9-81c0-2c63d878d46d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:51.625003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fb53-baf6-45b9-81c0-2c63d878d46d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:51.625003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fb53-baf6-45b9-81c0-2c63d878d46d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:51.626350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 25/47] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:51.631457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d255-a018-4154-a895-3943213ab1f0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:51.631893 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d255-a018-4154-a895-3943213ab1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:51.632234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d255-a018-4154-a895-3943213ab1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:51.651199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7310d255-a018-4154-a895-3943213ab1f0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:51.652443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7310d255-a018-4154-a895-3943213ab1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:51.715007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:51.724231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 23/48] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:51.746905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716fb53-baf6-45b9-81c0-2c63d878d46d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:51.850216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716fb53-baf6-45b9-81c0-2c63d878d46d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:51.884646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7c3ef-274c-40c0-b441-d73b09ddcb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:51.885216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c3ef-274c-40c0-b441-d73b09ddcb84 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:51.885500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c3ef-274c-40c0-b441-d73b09ddcb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:51.885776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c3ef-274c-40c0-b441-d73b09ddcb84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:51.896325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7c3ef-274c-40c0-b441-d73b09ddcb84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e1c7c3ef-274c-40c0-b441-d73b09ddcb84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:22:51.901745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:51.902607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:22:51.903467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 26/49] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:22:51.908692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310d255-a018-4154-a895-3943213ab1f0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:52.007089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310d255-a018-4154-a895-3943213ab1f0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:52.042873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78a06a-e4d8-41c0-8219-2171e8f3a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:52.043532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78a06a-e4d8-41c0-8219-2171e8f3a67b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:52.043828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78a06a-e4d8-41c0-8219-2171e8f3a67b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:52.044111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78a06a-e4d8-41c0-8219-2171e8f3a67b None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:52.044843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78a06a-e4d8-41c0-8219-2171e8f3a67b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:52.045157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78a06a-e4d8-41c0-8219-2171e8f3a67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:52.046600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78a06a-e4d8-41c0-8219-2171e8f3a67b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:52.059040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 24/50] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:52.064583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7c3ef-274c-40c0-b441-d73b09ddcb84 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:52.084731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:52.156452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7556-507a-489d-8bb9-b6faefb3ea90 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:52.156762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7556-507a-489d-8bb9-b6faefb3ea90 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:52.157116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7556-507a-489d-8bb9-b6faefb3ea90 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:52.158534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 25/51] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:22:52.163478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a086790-5a3d-4e6f-95b8-44f2141ad25f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:52.163775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a086790-5a3d-4e6f-95b8-44f2141ad25f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:52.164335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a086790-5a3d-4e6f-95b8-44f2141ad25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:52.174624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7c3ef-274c-40c0-b441-d73b09ddcb84 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:52.181959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1a086790-5a3d-4e6f-95b8-44f2141ad25f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:52.183177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1a086790-5a3d-4e6f-95b8-44f2141ad25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:52.209755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd6f90-d0b7-464e-9ca9-1ce0b8371f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:52.210404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6f90-d0b7-464e-9ca9-1ce0b8371f5e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:52.210691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6f90-d0b7-464e-9ca9-1ce0b8371f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:52.210970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6f90-d0b7-464e-9ca9-1ce0b8371f5e None admin] PATH_INFO: `/v3/users/4dac00d0ca0d4081a88ccba053ac2218` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:52.212876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd6f90-d0b7-464e-9ca9-1ce0b8371f5e None admin] RBAC: Authorizing `identity:get_user(user_id=4dac00d0ca0d4081a88ccba053ac2218)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:52.214389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd6f90-d0b7-464e-9ca9-1ce0b8371f5e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:52.216206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 27/52] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:22:52 2022] GET /identity/v3/users/4dac00d0ca0d4081a88ccba053ac2218 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:52.221534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd6f90-d0b7-464e-9ca9-1ce0b8371f5e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:52.255809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:52.270963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 26/53] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:22:52.294238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a086790-5a3d-4e6f-95b8-44f2141ad25f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:52.318747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:52.336936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd6f90-d0b7-464e-9ca9-1ce0b8371f5e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:52.374397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ec169-a754-4870-94a9-4b1fa63b00f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:52.375042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec169-a754-4870-94a9-4b1fa63b00f1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:52.375331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec169-a754-4870-94a9-4b1fa63b00f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:52.375637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec169-a754-4870-94a9-4b1fa63b00f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:52.376956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ec169-a754-4870-94a9-4b1fa63b00f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:52.378255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ec169-a754-4870-94a9-4b1fa63b00f1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:52.380184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 28/54] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:22:52.386540 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ec169-a754-4870-94a9-4b1fa63b00f1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:52.405965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a086790-5a3d-4e6f-95b8-44f2141ad25f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:52.441929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6562d-8d62-4835-a9ed-c029eb89d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:52.442569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6562d-8d62-4835-a9ed-c029eb89d79f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:52.442869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6562d-8d62-4835-a9ed-c029eb89d79f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:52.443147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6562d-8d62-4835-a9ed-c029eb89d79f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:52.444346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6562d-8d62-4835-a9ed-c029eb89d79f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:52.446438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6562d-8d62-4835-a9ed-c029eb89d79f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:52.448378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:22:52.454083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6562d-8d62-4835-a9ed-c029eb89d79f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:52.508020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ec169-a754-4870-94a9-4b1fa63b00f1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:52.516781 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:52.543077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733d44f-2c42-43ae-b2dc-c0396dd6add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:52.543743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733d44f-2c42-43ae-b2dc-c0396dd6add4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:52.544032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733d44f-2c42-43ae-b2dc-c0396dd6add4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:52.544313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733d44f-2c42-43ae-b2dc-c0396dd6add4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:52.545106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733d44f-2c42-43ae-b2dc-c0396dd6add4 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.domain.id=default, user.id=4dac00d0ca0d4081a88ccba053ac2218) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:52.545422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733d44f-2c42-43ae-b2dc-c0396dd6add4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:52.546880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733d44f-2c42-43ae-b2dc-c0396dd6add4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:52.552681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 29/56] 10.222.0.71 () {56 vars in 1322 bytes} [Mon Aug 1 15:22:52 2022] GET /identity/v3/role_assignments?user.id=4dac00d0ca0d4081a88ccba053ac2218&scope.domain.id=default&role.id=7a7079c0864e4bb7acaa71238097426e => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:22:52.563241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6562d-8d62-4835-a9ed-c029eb89d79f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:52.601548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca0965-46b9-4e09-9d9a-6bce082785f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:52.602350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca0965-46b9-4e09-9d9a-6bce082785f7 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:52.602645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca0965-46b9-4e09-9d9a-6bce082785f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:52.602927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca0965-46b9-4e09-9d9a-6bce082785f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:52.603666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca0965-46b9-4e09-9d9a-6bce082785f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:52.605188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca0965-46b9-4e09-9d9a-6bce082785f7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:52.635117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 28/57] 10.222.0.71 () {60 vars in 1140 bytes} [Mon Aug 1 15:22:52 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:22:54.684334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de611099-12d2-49b2-a61b-42b4610267ab None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:54.684852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de611099-12d2-49b2-a61b-42b4610267ab None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:54.684935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de611099-12d2-49b2-a61b-42b4610267ab None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:54.686245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 30/58] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:54.691620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fc1c5-8076-484f-a878-35db0d88d2d9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:54.692038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fc1c5-8076-484f-a878-35db0d88d2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:54.692195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fc1c5-8076-484f-a878-35db0d88d2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:54.713260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-476fc1c5-8076-484f-a878-35db0d88d2d9 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:54.714491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-476fc1c5-8076-484f-a878-35db0d88d2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:54.782778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 29/59] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:54.807263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de611099-12d2-49b2-a61b-42b4610267ab None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:54.826647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:54.912126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de611099-12d2-49b2-a61b-42b4610267ab None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:54.948211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb77a3f-273a-4f9b-9dd4-f49ae2e625ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:54.948793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77a3f-273a-4f9b-9dd4-f49ae2e625ba None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:54.949079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77a3f-273a-4f9b-9dd4-f49ae2e625ba None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:54.949359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77a3f-273a-4f9b-9dd4-f49ae2e625ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:54.950526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb77a3f-273a-4f9b-9dd4-f49ae2e625ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:54.952030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb77a3f-273a-4f9b-9dd4-f49ae2e625ba None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:54.953669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 31/60] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:54.960033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fc1c5-8076-484f-a878-35db0d88d2d9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:54.999533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:55.060545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fc1c5-8076-484f-a878-35db0d88d2d9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:55.095846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b1200-3525-43c6-b180-83916c5c286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:55.096563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b1200-3525-43c6-b180-83916c5c286f None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:55.097313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b1200-3525-43c6-b180-83916c5c286f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:55.097597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b1200-3525-43c6-b180-83916c5c286f None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:55.098291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b1200-3525-43c6-b180-83916c5c286f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:55.099779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b1200-3525-43c6-b180-83916c5c286f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:55.128022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 30/61] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:22:54 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:22:58.512260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37a75-5576-4335-a281-2d0a27bdb17e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:58.513267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37a75-5576-4335-a281-2d0a27bdb17e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:58.513753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37a75-5576-4335-a281-2d0a27bdb17e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:58.515619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 32/62] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:58.521349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acee3a-9315-4da0-bdac-1270ad792487 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:58.522267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acee3a-9315-4da0-bdac-1270ad792487 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:58.522764 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acee3a-9315-4da0-bdac-1270ad792487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:58.550521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-84acee3a-9315-4da0-bdac-1270ad792487 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:58.551284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7fccf-cd54-4613-b4d1-a11c2359d5e8 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:58.551803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7fccf-cd54-4613-b4d1-a11c2359d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:58.551903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-84acee3a-9315-4da0-bdac-1270ad792487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:58.552390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7fccf-cd54-4613-b4d1-a11c2359d5e8 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:58.554113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 33/63] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:58.567023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77468e-0ac4-4ff5-ab63-e5a713f2d6dd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:58.567659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77468e-0ac4-4ff5-ab63-e5a713f2d6dd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:58.568273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77468e-0ac4-4ff5-ab63-e5a713f2d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:58.601437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9b77468e-0ac4-4ff5-ab63-e5a713f2d6dd None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:58.604175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9b77468e-0ac4-4ff5-ab63-e5a713f2d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:58.667933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 31/64] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:58.714970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acee3a-9315-4da0-bdac-1270ad792487 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:58.749216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 34/65] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:22:58.767988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:58.825709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77468e-0ac4-4ff5-ab63-e5a713f2d6dd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:58.854096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:58.892259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acee3a-9315-4da0-bdac-1270ad792487 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:58.948576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9993a1-2af2-4a90-98be-72aaa36763e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:58.949614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9993a1-2af2-4a90-98be-72aaa36763e2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:58.950194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9993a1-2af2-4a90-98be-72aaa36763e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:58.950616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9993a1-2af2-4a90-98be-72aaa36763e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:58.965078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9993a1-2af2-4a90-98be-72aaa36763e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-af9993a1-2af2-4a90-98be-72aaa36763e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:22:58.970797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:58.971772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:22:58.972604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 32/66] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:22:58.974079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5d77-751c-453e-900f-116123e8fa10 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:58.974079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5d77-751c-453e-900f-116123e8fa10 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:58.976311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5d77-751c-453e-900f-116123e8fa10 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:58.977225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 33/67] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:58.978034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c41a-d229-4d8b-a730-e7ca9645bb4b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:58.978322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c41a-d229-4d8b-a730-e7ca9645bb4b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:58.978715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c41a-d229-4d8b-a730-e7ca9645bb4b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:58.980821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 34/68] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:58.983800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801344e3-e120-4493-a0a8-7f05f582495c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:58.983886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77468e-0ac4-4ff5-ab63-e5a713f2d6dd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:58.983957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801344e3-e120-4493-a0a8-7f05f582495c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:58.983957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801344e3-e120-4493-a0a8-7f05f582495c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:58.983957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 35/69] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:22:58.983957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801344e3-e120-4493-a0a8-7f05f582495c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:59.026025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416fae2-a4c9-4223-91f1-5eefb74e2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.026618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416fae2-a4c9-4223-91f1-5eefb74e2858 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.026906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416fae2-a4c9-4223-91f1-5eefb74e2858 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.027183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416fae2-a4c9-4223-91f1-5eefb74e2858 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.041460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416fae2-a4c9-4223-91f1-5eefb74e2858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-0416fae2-a4c9-4223-91f1-5eefb74e2858 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:22:59.048760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:59.049620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:22:59.050620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 35/70] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:22:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:22:59.052292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6297f1-a563-4e39-af5d-d6ae764dfc55 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.052292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6297f1-a563-4e39-af5d-d6ae764dfc55 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.052292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6297f1-a563-4e39-af5d-d6ae764dfc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.070534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ea6297f1-a563-4e39-af5d-d6ae764dfc55 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:59.074290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ea6297f1-a563-4e39-af5d-d6ae764dfc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:59.090572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.114248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801344e3-e120-4493-a0a8-7f05f582495c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:59.158349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b40f2b-dd2b-42b0-9abc-6510b2b2710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.159443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40f2b-dd2b-42b0-9abc-6510b2b2710f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.159950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40f2b-dd2b-42b0-9abc-6510b2b2710f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.160449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40f2b-dd2b-42b0-9abc-6510b2b2710f None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.161773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b40f2b-dd2b-42b0-9abc-6510b2b2710f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:59.162321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b40f2b-dd2b-42b0-9abc-6510b2b2710f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:59.165812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b40f2b-dd2b-42b0-9abc-6510b2b2710f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:59.169543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 36/71] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:59.170851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a630cf2-abe1-404e-94e0-8fbf540b1faa None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.171191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a630cf2-abe1-404e-94e0-8fbf540b1faa None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.171534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a630cf2-abe1-404e-94e0-8fbf540b1faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.179835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 36/72] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:22:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:59.182989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abf078-c231-4dd0-a62f-ee37e1e51104 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.183838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abf078-c231-4dd0-a62f-ee37e1e51104 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.184597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abf078-c231-4dd0-a62f-ee37e1e51104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.189435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.208223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0a630cf2-abe1-404e-94e0-8fbf540b1faa None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:59.209517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0a630cf2-abe1-404e-94e0-8fbf540b1faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:59.209885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b3abf078-c231-4dd0-a62f-ee37e1e51104 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:22:59.211663 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b3abf078-c231-4dd0-a62f-ee37e1e51104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:22:59.299180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 37/73] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:59.299180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a630cf2-abe1-404e-94e0-8fbf540b1faa None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:59.311973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 37/74] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:59.311973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abf078-c231-4dd0-a62f-ee37e1e51104 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:59.397271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.421638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abf078-c231-4dd0-a62f-ee37e1e51104 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:59.427443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a630cf2-abe1-404e-94e0-8fbf540b1faa None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:59.459111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2653d2e-9920-4c5d-9d48-1d9bbb54531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.459794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653d2e-9920-4c5d-9d48-1d9bbb54531a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.460083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653d2e-9920-4c5d-9d48-1d9bbb54531a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.460371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653d2e-9920-4c5d-9d48-1d9bbb54531a None admin] PATH_INFO: `/v3/users/4dac00d0ca0d4081a88ccba053ac2218` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.462137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2653d2e-9920-4c5d-9d48-1d9bbb54531a None admin] RBAC: Authorizing `identity:get_user(user_id=4dac00d0ca0d4081a88ccba053ac2218)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:59.463627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2653d2e-9920-4c5d-9d48-1d9bbb54531a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:59.465259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 38/75] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:22:59 2022] GET /identity/v3/users/4dac00d0ca0d4081a88ccba053ac2218 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:59.466020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2653d2e-9920-4c5d-9d48-1d9bbb54531a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:59.470811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.471485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.471773 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.472048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.472774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:22:59.473081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:59.474477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:59.476251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.486097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 38/76] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:22:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:59.486936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:59.581048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2653d2e-9920-4c5d-9d48-1d9bbb54531a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:59.598248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980ca1-4896-4630-8878-73a5b6ccd76a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:59.629674 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c68e5-67ce-46a9-a0a9-5bcc8136baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.630733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c68e5-67ce-46a9-a0a9-5bcc8136baaf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.631362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c68e5-67ce-46a9-a0a9-5bcc8136baaf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.632179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c68e5-67ce-46a9-a0a9-5bcc8136baaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.634767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce582-ebd3-47b0-97d7-2ddf9e9ff1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.635444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce582-ebd3-47b0-97d7-2ddf9e9ff1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.635733 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce582-ebd3-47b0-97d7-2ddf9e9ff1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.636012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce582-ebd3-47b0-97d7-2ddf9e9ff1b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.637368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdce582-ebd3-47b0-97d7-2ddf9e9ff1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:59.638825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdce582-ebd3-47b0-97d7-2ddf9e9ff1b4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:59.640455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 39/77] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:22:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:59.641233 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce582-ebd3-47b0-97d7-2ddf9e9ff1b4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:59.645958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c68e5-67ce-46a9-a0a9-5bcc8136baaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-017c68e5-67ce-46a9-a0a9-5bcc8136baaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:22:59.652728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:59.653588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:22:59.654307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 39/78] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:22:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:22:59.654928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c68e5-67ce-46a9-a0a9-5bcc8136baaf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:59.659813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.714325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.754738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce582-ebd3-47b0-97d7-2ddf9e9ff1b4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:59.761690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c68e5-67ce-46a9-a0a9-5bcc8136baaf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:59.796064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9396-52cc-431f-b09a-0f3bbeb2bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.796724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9396-52cc-431f-b09a-0f3bbeb2bee8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.797013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9396-52cc-431f-b09a-0f3bbeb2bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.797299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9396-52cc-431f-b09a-0f3bbeb2bee8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.798962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31ea8b-5e1c-459c-aa8c-c249f8b2693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.799809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31ea8b-5e1c-459c-aa8c-c249f8b2693c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.800010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31ea8b-5e1c-459c-aa8c-c249f8b2693c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.800295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31ea8b-5e1c-459c-aa8c-c249f8b2693c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.808120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c9396-52cc-431f-b09a-0f3bbeb2bee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-369c9396-52cc-431f-b09a-0f3bbeb2bee8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:22:59.813564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:22:59.814521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:22:59.815419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 40/79] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:22:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:22:59.816499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9396-52cc-431f-b09a-0f3bbeb2bee8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:22:59.881364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31ea8b-5e1c-459c-aa8c-c249f8b2693c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:59.882622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31ea8b-5e1c-459c-aa8c-c249f8b2693c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:59.885541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.929630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9396-52cc-431f-b09a-0f3bbeb2bee8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:22:59.954719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.968076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a321d6-f40d-4d84-adbc-4966c5344845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:22:59.968728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a321d6-f40d-4d84-adbc-4966c5344845 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:22:59.969011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a321d6-f40d-4d84-adbc-4966c5344845 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:22:59.969286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a321d6-f40d-4d84-adbc-4966c5344845 None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:22:59.985699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a321d6-f40d-4d84-adbc-4966c5344845 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:22:59.987204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a321d6-f40d-4d84-adbc-4966c5344845 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:22:59.988978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 41/80] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:22:59 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:22:59.989745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a321d6-f40d-4d84-adbc-4966c5344845 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.003812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 40/81] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:00.004665 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31ea8b-5e1c-459c-aa8c-c249f8b2693c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.099989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a321d6-f40d-4d84-adbc-4966c5344845 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:00.108351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31ea8b-5e1c-459c-aa8c-c249f8b2693c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:00.110686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.143556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97915309-df96-4862-895b-e8f8b939edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:00.144099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97915309-df96-4862-895b-e8f8b939edc5 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:00.144386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97915309-df96-4862-895b-e8f8b939edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:00.144501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:00.144663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97915309-df96-4862-895b-e8f8b939edc5 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:00.145126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:00.145356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97915309-df96-4862-895b-e8f8b939edc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:00.145441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:00.145672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:00.146384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:00.146690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:00.146910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97915309-df96-4862-895b-e8f8b939edc5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:00.148074 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:00.156848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 41/82] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:00.157650 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.181592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 42/83] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:22:59 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:00.182410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97915309-df96-4862-895b-e8f8b939edc5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.270150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.315309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fb6a3-ae78-4077-b7e4-e22724861e2d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:00.355953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97915309-df96-4862-895b-e8f8b939edc5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:00.378189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:00.379090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:00.379635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:00.380087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:00.381320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:00.381840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:00.384220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:00.397083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 42/84] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:00.398499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.409183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cb43c-dce5-4f28-913d-ef0d24bb60da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:00.409832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cb43c-dce5-4f28-913d-ef0d24bb60da None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:00.410115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cb43c-dce5-4f28-913d-ef0d24bb60da None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:00.410388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cb43c-dce5-4f28-913d-ef0d24bb60da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:00.439767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.505615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cb43c-dce5-4f28-913d-ef0d24bb60da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:00.507479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cb43c-dce5-4f28-913d-ef0d24bb60da None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:00.535336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32a100-23c7-414c-8b07-4f062a5911d4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:00.551803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.577043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c49e-bc20-4dde-9e36-f07ae68e1ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:00.578326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c49e-bc20-4dde-9e36-f07ae68e1ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:00.578618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c49e-bc20-4dde-9e36-f07ae68e1ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:00.578903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c49e-bc20-4dde-9e36-f07ae68e1ed6 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:00.580150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67c49e-bc20-4dde-9e36-f07ae68e1ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:00.581791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67c49e-bc20-4dde-9e36-f07ae68e1ed6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:00.585140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 43/85] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:00.585922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c49e-bc20-4dde-9e36-f07ae68e1ed6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.643212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 43/86] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:00.649171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cb43c-dce5-4f28-913d-ef0d24bb60da None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.707404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.714918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c49e-bc20-4dde-9e36-f07ae68e1ed6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:00.753502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87cc7-5bd3-4b9c-b818-187a11871ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:00.754188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87cc7-5bd3-4b9c-b818-187a11871ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:00.754551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87cc7-5bd3-4b9c-b818-187a11871ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:00.754961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87cc7-5bd3-4b9c-b818-187a11871ca0 None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:00.756293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87cc7-5bd3-4b9c-b818-187a11871ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:00.758407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87cc7-5bd3-4b9c-b818-187a11871ca0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:00.760312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 44/87] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:00.761099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87cc7-5bd3-4b9c-b818-187a11871ca0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.792776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cb43c-dce5-4f28-913d-ef0d24bb60da None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:00.845118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd235328-ae1b-451a-a0bf-f28ee3e13a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:00.846507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd235328-ae1b-451a-a0bf-f28ee3e13a14 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:00.846875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd235328-ae1b-451a-a0bf-f28ee3e13a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:00.847238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd235328-ae1b-451a-a0bf-f28ee3e13a14 None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:00.848715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd235328-ae1b-451a-a0bf-f28ee3e13a14 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:00.850946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd235328-ae1b-451a-a0bf-f28ee3e13a14 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:00.853798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 44/88] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:00.854690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd235328-ae1b-451a-a0bf-f28ee3e13a14 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.866973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.883843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87cc7-5bd3-4b9c-b818-187a11871ca0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:00.920449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:00.921115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:00.921459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:00.922263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:00.922795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=fc7e31d30c684107b874c500626aa093, user.id=4dac00d0ca0d4081a88ccba053ac2218) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:00.923188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:00.924758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:00.934558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 45/89] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/role_assignments?user.id=4dac00d0ca0d4081a88ccba053ac2218&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=7a7079c0864e4bb7acaa71238097426e => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:00.935539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:00.968939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.994775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd235328-ae1b-451a-a0bf-f28ee3e13a14 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:01.057822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e62bd-39e7-4eff-aa52-03c22d1af53a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:01.061187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd641e58-d013-49da-9824-109c9d5dde34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:01.062073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd641e58-d013-49da-9824-109c9d5dde34 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:01.062504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd641e58-d013-49da-9824-109c9d5dde34 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:01.063146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd641e58-d013-49da-9824-109c9d5dde34 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:01.066655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd641e58-d013-49da-9824-109c9d5dde34 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:01.068796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd641e58-d013-49da-9824-109c9d5dde34 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:01.071182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 45/90] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:01.076374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd641e58-d013-49da-9824-109c9d5dde34 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:01.097343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adb3e-8cd4-4308-a296-b136d6aa13e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:01.097977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adb3e-8cd4-4308-a296-b136d6aa13e9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:01.098266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adb3e-8cd4-4308-a296-b136d6aa13e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:01.098599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adb3e-8cd4-4308-a296-b136d6aa13e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:01.177996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304adb3e-8cd4-4308-a296-b136d6aa13e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:01.181924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304adb3e-8cd4-4308-a296-b136d6aa13e9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:01.214985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:01.217544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:01.258888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd641e58-d013-49da-9824-109c9d5dde34 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:01.311318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 46/91] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:01.312121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adb3e-8cd4-4308-a296-b136d6aa13e9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:01.333141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd707-f46f-4173-bee9-8eb045f00a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:01.333976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd707-f46f-4173-bee9-8eb045f00a81 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:01.334264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd707-f46f-4173-bee9-8eb045f00a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:01.334590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd707-f46f-4173-bee9-8eb045f00a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:01.431214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bd707-f46f-4173-bee9-8eb045f00a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:01.432526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adb3e-8cd4-4308-a296-b136d6aa13e9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:01.432709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bd707-f46f-4173-bee9-8eb045f00a81 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:01.463744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:01.473362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:01.474047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:01.474337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:01.474616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:01.475445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] RBAC: Adding query filter params (role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=fc7e31d30c684107b874c500626aa093, user.id=0db8cbec685146f29926d156e74d541f) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:01.475872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:01.478006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:01.485065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 47/92] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:01 2022] GET /identity/v3/role_assignments?user.id=0db8cbec685146f29926d156e74d541f&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=cb911cef057e44fb9c8004a419568df8 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:01.485973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:01.547149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:01.584716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 46/93] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:01.598188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd707-f46f-4173-bee9-8eb045f00a81 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:01.681535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe49d-e6ea-4d1b-8101-531cadb73bbc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:01.723643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd707-f46f-4173-bee9-8eb045f00a81 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:01.763186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a9c9-6557-4328-9ccb-e19f14659e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:01.763992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a9c9-6557-4328-9ccb-e19f14659e7b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:01.764368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a9c9-6557-4328-9ccb-e19f14659e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:01.764717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a9c9-6557-4328-9ccb-e19f14659e7b None admin] PATH_INFO: `/v3/projects/a75c8c3d3f5848ae8c7f13da5976da51` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:01.765992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998a9c9-6557-4328-9ccb-e19f14659e7b None admin] RBAC: Authorizing `identity:get_project(project_id=a75c8c3d3f5848ae8c7f13da5976da51)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:01.767641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998a9c9-6557-4328-9ccb-e19f14659e7b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:01.769827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 47/94] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:01 2022] GET /identity/v3/projects/a75c8c3d3f5848ae8c7f13da5976da51 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:01.776632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a9c9-6557-4328-9ccb-e19f14659e7b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:01.796935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309c2e6-51af-43d8-a4f1-7f8af9044db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:01.797608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309c2e6-51af-43d8-a4f1-7f8af9044db5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:01.797892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309c2e6-51af-43d8-a4f1-7f8af9044db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:01.798170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309c2e6-51af-43d8-a4f1-7f8af9044db5 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:01.799402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309c2e6-51af-43d8-a4f1-7f8af9044db5 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:01.800876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309c2e6-51af-43d8-a4f1-7f8af9044db5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:01.802755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 48/95] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:01 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:01.812446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309c2e6-51af-43d8-a4f1-7f8af9044db5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:01.851793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:01.919834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:01.943679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a9c9-6557-4328-9ccb-e19f14659e7b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:01.991417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309c2e6-51af-43d8-a4f1-7f8af9044db5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:02.026371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4890c1-deb2-4954-8f09-32006432ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:02.027462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4890c1-deb2-4954-8f09-32006432ed7e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:02.028310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4890c1-deb2-4954-8f09-32006432ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:02.028742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4890c1-deb2-4954-8f09-32006432ed7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:02.029889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4890c1-deb2-4954-8f09-32006432ed7e None admin] RBAC: Adding query filter params (role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=a75c8c3d3f5848ae8c7f13da5976da51, user.id=0db8cbec685146f29926d156e74d541f) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:02.030484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4890c1-deb2-4954-8f09-32006432ed7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:02.032546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4890c1-deb2-4954-8f09-32006432ed7e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:02.046326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 48/96] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:01 2022] GET /identity/v3/role_assignments?user.id=0db8cbec685146f29926d156e74d541f&scope.project.id=a75c8c3d3f5848ae8c7f13da5976da51&role.id=cb911cef057e44fb9c8004a419568df8 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:02.056409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0e774-3646-449d-ad9d-8fc55e2a77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:02.057068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e774-3646-449d-ad9d-8fc55e2a77a9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:02.057450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e774-3646-449d-ad9d-8fc55e2a77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:02.057745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e774-3646-449d-ad9d-8fc55e2a77a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:02.058585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0e774-3646-449d-ad9d-8fc55e2a77a9 None admin] RBAC: Adding query filter params (role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=fc7e31d30c684107b874c500626aa093, user.id=0db8cbec685146f29926d156e74d541f) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:02.059129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0e774-3646-449d-ad9d-8fc55e2a77a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:02.060974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0e774-3646-449d-ad9d-8fc55e2a77a9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:02.068139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 49/97] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:01 2022] GET /identity/v3/role_assignments?user.id=0db8cbec685146f29926d156e74d541f&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:02.915461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83e23-3bb9-4ba1-9a32-cf7ac2d5d80e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:02.916491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83e23-3bb9-4ba1-9a32-cf7ac2d5d80e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:02.916973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83e23-3bb9-4ba1-9a32-cf7ac2d5d80e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:02.918628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 49/98] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:02.924716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8148fa-2ed3-4152-ad2e-cf781dd1178e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:02.925252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8148fa-2ed3-4152-ad2e-cf781dd1178e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:02.925514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8148fa-2ed3-4152-ad2e-cf781dd1178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:02.951195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0b8148fa-2ed3-4152-ad2e-cf781dd1178e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:02.952426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0b8148fa-2ed3-4152-ad2e-cf781dd1178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:03.006958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aff69-5e71-4c26-b34c-2cb608b217cf None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.007260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aff69-5e71-4c26-b34c-2cb608b217cf None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.007557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aff69-5e71-4c26-b34c-2cb608b217cf None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:03.009774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 50/99] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:03.015088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f6af-8b61-450a-83fe-a2f7fd5fb20f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.015387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f6af-8b61-450a-83fe-a2f7fd5fb20f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.015675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f6af-8b61-450a-83fe-a2f7fd5fb20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:03.046989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e2b3f6af-8b61-450a-83fe-a2f7fd5fb20f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:03.048212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e2b3f6af-8b61-450a-83fe-a2f7fd5fb20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:03.065620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 50/100] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:03.104086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8148fa-2ed3-4152-ad2e-cf781dd1178e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:03.187952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 51/101] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:03.209320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:03.251919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3f6af-8b61-450a-83fe-a2f7fd5fb20f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:03.310572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8148fa-2ed3-4152-ad2e-cf781dd1178e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:03.342714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:03.417514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d5ee7-7f0b-4731-9954-b0f96dea155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:03.418423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d5ee7-7f0b-4731-9954-b0f96dea155d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.418857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d5ee7-7f0b-4731-9954-b0f96dea155d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.419279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d5ee7-7f0b-4731-9954-b0f96dea155d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:03.431721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3f6af-8b61-450a-83fe-a2f7fd5fb20f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:03.460073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d5ee7-7f0b-4731-9954-b0f96dea155d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ea8d5ee7-7f0b-4731-9954-b0f96dea155d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:03.465483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:03.466460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:03.467518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:03.475498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 51/102] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:03.479331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372d8b2-5836-405d-851d-0d5d172ace9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:03.480467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372d8b2-5836-405d-851d-0d5d172ace9d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.480957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372d8b2-5836-405d-851d-0d5d172ace9d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.481444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372d8b2-5836-405d-851d-0d5d172ace9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:03.487270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372d8b2-5836-405d-851d-0d5d172ace9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:03.490080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372d8b2-5836-405d-851d-0d5d172ace9d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:03.494126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 52/103] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:03.503123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d5ee7-7f0b-4731-9954-b0f96dea155d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:03.509965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372d8b2-5836-405d-851d-0d5d172ace9d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:03.675284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372d8b2-5836-405d-851d-0d5d172ace9d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:03.677891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:03.715877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:03.716448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.716731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.717010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:03.717738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:03.718044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:03.719293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d5ee7-7f0b-4731-9954-b0f96dea155d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:03.719503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:03.732030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 53/104] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:03.737853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:03.744956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:03.785102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e10c5e-8d2c-43e7-b52f-f3012eb529ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:03.785753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e10c5e-8d2c-43e7-b52f-f3012eb529ff None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.786080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e10c5e-8d2c-43e7-b52f-f3012eb529ff None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.786438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e10c5e-8d2c-43e7-b52f-f3012eb529ff None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:03.787144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e10c5e-8d2c-43e7-b52f-f3012eb529ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:03.788794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e10c5e-8d2c-43e7-b52f-f3012eb529ff None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:03.841409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 52/105] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:23:03 2022] POST /identity/v3/projects => generated 302 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:03.843131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975523-db6c-47d3-b136-63f0328066bd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.843694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975523-db6c-47d3-b136-63f0328066bd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.844258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975523-db6c-47d3-b136-63f0328066bd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:03.846667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 53/106] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:03.853704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf140-82c1-460a-9142-007d1bcf407a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.854423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf140-82c1-460a-9142-007d1bcf407a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.854937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf140-82c1-460a-9142-007d1bcf407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:03.888843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d31a-1c0d-4f1a-badf-5d461b5778e8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:03.906225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7d3bf140-82c1-460a-9142-007d1bcf407a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:03.907899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7d3bf140-82c1-460a-9142-007d1bcf407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:03.971111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817874d-b6f1-4c0a-86ae-528c936b6d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:03.974904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817874d-b6f1-4c0a-86ae-528c936b6d86 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:03.975474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817874d-b6f1-4c0a-86ae-528c936b6d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:03.976841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817874d-b6f1-4c0a-86ae-528c936b6d86 None admin] PATH_INFO: `/v3/users/b4ceaa3593324e618949bc826b95c8a7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:04.007426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817874d-b6f1-4c0a-86ae-528c936b6d86 None admin] RBAC: Authorizing `identity:get_user(user_id=b4ceaa3593324e618949bc826b95c8a7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:04.009582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817874d-b6f1-4c0a-86ae-528c936b6d86 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:04.011871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 54/107] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:03 2022] GET /identity/v3/users/b4ceaa3593324e618949bc826b95c8a7 => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:04.020382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817874d-b6f1-4c0a-86ae-528c936b6d86 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:04.038547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 54/108] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:04.072917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:04.087542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bf140-82c1-460a-9142-007d1bcf407a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:04.203660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817874d-b6f1-4c0a-86ae-528c936b6d86 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:04.247025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9019-3472-4c1d-bd2a-8aac22944230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:04.248094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9019-3472-4c1d-bd2a-8aac22944230 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:04.248094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9019-3472-4c1d-bd2a-8aac22944230 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:04.248217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9019-3472-4c1d-bd2a-8aac22944230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:04.274059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:04.290580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bf140-82c1-460a-9142-007d1bcf407a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:04.332149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab9019-3472-4c1d-bd2a-8aac22944230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:04.334029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab9019-3472-4c1d-bd2a-8aac22944230 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:04.347862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657f547-efc3-45fe-a63c-689c7b769cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:04.348649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f547-efc3-45fe-a63c-689c7b769cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:04.349039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f547-efc3-45fe-a63c-689c7b769cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:04.349423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f547-efc3-45fe-a63c-689c7b769cb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:04.374790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657f547-efc3-45fe-a63c-689c7b769cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:04.374978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d657f547-efc3-45fe-a63c-689c7b769cb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:04.388414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:04.389328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:04.390053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 55/109] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:23:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:04.398843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657f547-efc3-45fe-a63c-689c7b769cb7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:04.549106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657f547-efc3-45fe-a63c-689c7b769cb7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:04.558381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 55/110] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:04.576484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9019-3472-4c1d-bd2a-8aac22944230 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:04.624168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:04.624845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:04.625137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:04.625419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:04.626159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:04.626467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:04.627924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:04.637708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 56/111] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:04.644504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:04.679891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:04.800851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9019-3472-4c1d-bd2a-8aac22944230 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:04.875838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:04.898764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d8b04-4df7-48d6-8101-2b5fb4d5fdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:04.899517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8b04-4df7-48d6-8101-2b5fb4d5fdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:04.899808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8b04-4df7-48d6-8101-2b5fb4d5fdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:04.900088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8b04-4df7-48d6-8101-2b5fb4d5fdb6 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:04.901461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d8b04-4df7-48d6-8101-2b5fb4d5fdb6 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:04.902881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fdd37-c50a-4e0d-a189-8f6724059404 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:04.903006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d8b04-4df7-48d6-8101-2b5fb4d5fdb6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:04.905125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 56/112] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:04 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:04.913768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d8b04-4df7-48d6-8101-2b5fb4d5fdb6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:04.981822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddbf71-31be-4d51-946f-eb6db9fdb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:04.982493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddbf71-31be-4d51-946f-eb6db9fdb0eb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:04.982783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddbf71-31be-4d51-946f-eb6db9fdb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:04.983069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddbf71-31be-4d51-946f-eb6db9fdb0eb None admin] PATH_INFO: `/v3/users/4dac00d0ca0d4081a88ccba053ac2218` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:04.985867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddbf71-31be-4d51-946f-eb6db9fdb0eb None admin] RBAC: Authorizing `identity:get_user(user_id=4dac00d0ca0d4081a88ccba053ac2218)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:04.988371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddbf71-31be-4d51-946f-eb6db9fdb0eb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:04.990069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 57/113] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:04 2022] GET /identity/v3/users/4dac00d0ca0d4081a88ccba053ac2218 => generated 247 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:04.998032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddbf71-31be-4d51-946f-eb6db9fdb0eb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:05.139113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d8b04-4df7-48d6-8101-2b5fb4d5fdb6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:05.197900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:05.216647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddbf71-31be-4d51-946f-eb6db9fdb0eb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:05.260147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea03d7c-219a-4edc-851e-e93c9ffeb6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:05.260811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea03d7c-219a-4edc-851e-e93c9ffeb6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:05.260963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140421-450a-460d-8671-88bff0b562e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:05.261188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea03d7c-219a-4edc-851e-e93c9ffeb6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:05.261440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea03d7c-219a-4edc-851e-e93c9ffeb6c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:05.261600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140421-450a-460d-8671-88bff0b562e4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:05.261846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140421-450a-460d-8671-88bff0b562e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:05.262135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140421-450a-460d-8671-88bff0b562e4 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:05.262243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea03d7c-219a-4edc-851e-e93c9ffeb6c2 None admin] RBAC: Adding query filter params (role.id=c31070d0b9f143a49945c541a812a52e, scope.project.id=fc7e31d30c684107b874c500626aa093, user.id=b4ceaa3593324e618949bc826b95c8a7) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:05.262459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea03d7c-219a-4edc-851e-e93c9ffeb6c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:05.263399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2140421-450a-460d-8671-88bff0b562e4 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:05.263975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea03d7c-219a-4edc-851e-e93c9ffeb6c2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:05.265471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2140421-450a-460d-8671-88bff0b562e4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:05.267578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 58/114] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:04 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:05.273620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140421-450a-460d-8671-88bff0b562e4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:05.282074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 57/115] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:04 2022] GET /identity/v3/role_assignments?user.id=b4ceaa3593324e618949bc826b95c8a7&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=c31070d0b9f143a49945c541a812a52e => generated 259 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:05.295730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f03b-1a05-4f55-952a-72e7f8ea773f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:05.296025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f03b-1a05-4f55-952a-72e7f8ea773f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:05.296309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f03b-1a05-4f55-952a-72e7f8ea773f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:05.297845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 58/116] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:05.305069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b9345-f6f2-4a83-96f2-9637f585826e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:05.305397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b9345-f6f2-4a83-96f2-9637f585826e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:05.305666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b9345-f6f2-4a83-96f2-9637f585826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:05.349163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-fc9b9345-f6f2-4a83-96f2-9637f585826e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:05.351028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fc9b9345-f6f2-4a83-96f2-9637f585826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:05.396417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140421-450a-460d-8671-88bff0b562e4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:05.439908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee03a78-c6dc-48c3-b66f-5a6700544736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:05.440609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee03a78-c6dc-48c3-b66f-5a6700544736 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:05.440897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee03a78-c6dc-48c3-b66f-5a6700544736 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:05.441179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee03a78-c6dc-48c3-b66f-5a6700544736 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093/users/4dac00d0ca0d4081a88ccba053ac2218/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:05.443456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee03a78-c6dc-48c3-b66f-5a6700544736 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e31d30c684107b874c500626aa093, user_id=4dac00d0ca0d4081a88ccba053ac2218, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:05.445331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee03a78-c6dc-48c3-b66f-5a6700544736 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:05.467712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 59/117] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:05 2022] PUT /identity/v3/projects/fc7e31d30c684107b874c500626aa093/users/4dac00d0ca0d4081a88ccba053ac2218/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:23:05.491863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2fcc5-c167-4ba0-96ac-c5f0262dd070 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:05.492350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2fcc5-c167-4ba0-96ac-c5f0262dd070 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:05.492788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2fcc5-c167-4ba0-96ac-c5f0262dd070 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:05.494340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 60/118] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:05.501553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ad49d-c7ee-4289-bf5c-3284104d5404 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:05.501885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ad49d-c7ee-4289-bf5c-3284104d5404 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:05.502129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ad49d-c7ee-4289-bf5c-3284104d5404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:05.508279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:05.540950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ea3ad49d-c7ee-4289-bf5c-3284104d5404 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:05.542414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ea3ad49d-c7ee-4289-bf5c-3284104d5404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:05.549923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 59/119] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:05.574174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:05.580423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b9345-f6f2-4a83-96f2-9637f585826e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:05.728643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 61/120] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:05.743610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b9345-f6f2-4a83-96f2-9637f585826e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:05.754740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ad49d-c7ee-4289-bf5c-3284104d5404 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:05.830257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d653-206d-494b-90da-50869e39175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:05.830975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d653-206d-494b-90da-50869e39175e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:05.831260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d653-206d-494b-90da-50869e39175e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:05.831579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d653-206d-494b-90da-50869e39175e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:05.857697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d653-206d-494b-90da-50869e39175e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-31c7d653-206d-494b-90da-50869e39175e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:05.867221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:05.868115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:05.868883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:05.870611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 60/121] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:05.875494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d653-206d-494b-90da-50869e39175e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:05.975673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ad49d-c7ee-4289-bf5c-3284104d5404 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:06.028285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:06.051291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d653-206d-494b-90da-50869e39175e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:06.056544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962c860-3d7b-4adb-8f32-2e978a83c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:06.057581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c860-3d7b-4adb-8f32-2e978a83c695 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:06.058062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c860-3d7b-4adb-8f32-2e978a83c695 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:06.058742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c860-3d7b-4adb-8f32-2e978a83c695 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:06.077404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962c860-3d7b-4adb-8f32-2e978a83c695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8962c860-3d7b-4adb-8f32-2e978a83c695 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:06.083522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:06.084367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:06.085106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:06.088321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 62/122] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:06.089816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429fde1-4aa8-41a2-8522-d76d1951af38 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:06.090351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429fde1-4aa8-41a2-8522-d76d1951af38 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:06.090828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429fde1-4aa8-41a2-8522-d76d1951af38 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:06.092480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 63/123] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:06.099215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de57c2-2f43-4771-9147-67c1a62a975e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:06.100099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de57c2-2f43-4771-9147-67c1a62a975e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:06.100705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de57c2-2f43-4771-9147-67c1a62a975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:06.109963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:06.123508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-95de57c2-2f43-4771-9147-67c1a62a975e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:06.125038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-95de57c2-2f43-4771-9147-67c1a62a975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:06.144620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:06.145305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:06.145579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:06.145859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:06.146585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:06.146897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:06.149090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:06.160549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 61/124] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:06.161242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:06.304303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5a2eb-1f03-4fa0-a2ab-d9f22e90f526 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:06.319775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:06.343106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 64/125] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:06.344019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de57c2-2f43-4771-9147-67c1a62a975e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:06.383118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a3671-6578-4658-9622-52642b3add46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:06.383801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a3671-6578-4658-9622-52642b3add46 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:06.384086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a3671-6578-4658-9622-52642b3add46 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:06.384364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a3671-6578-4658-9622-52642b3add46 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:06.385105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a3671-6578-4658-9622-52642b3add46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:06.385413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a3671-6578-4658-9622-52642b3add46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:06.386863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a3671-6578-4658-9622-52642b3add46 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:06.408114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 62/126] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:06.418681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a3671-6578-4658-9622-52642b3add46 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:06.564050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de57c2-2f43-4771-9147-67c1a62a975e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:06.607306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9590-1c76-4cdf-9887-2ae17987d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:06.608003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9590-1c76-4cdf-9887-2ae17987d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:06.608366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9590-1c76-4cdf-9887-2ae17987d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:06.608746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9590-1c76-4cdf-9887-2ae17987d7d1 None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:06.610066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e9590-1c76-4cdf-9887-2ae17987d7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:06.615401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e9590-1c76-4cdf-9887-2ae17987d7d1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:06.615401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 65/127] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:06 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:06.615401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9590-1c76-4cdf-9887-2ae17987d7d1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:06.620853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:06.670000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a3671-6578-4658-9622-52642b3add46 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:06.750948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9590-1c76-4cdf-9887-2ae17987d7d1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:06.760142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72072c8-1486-4b98-ad7f-71b146d4fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:06.760825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72072c8-1486-4b98-ad7f-71b146d4fac4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:06.761175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72072c8-1486-4b98-ad7f-71b146d4fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:06.761397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72072c8-1486-4b98-ad7f-71b146d4fac4 None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:06.768267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72072c8-1486-4b98-ad7f-71b146d4fac4 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:06.769865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72072c8-1486-4b98-ad7f-71b146d4fac4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:06.771762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 63/128] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:06 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:06.772461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72072c8-1486-4b98-ad7f-71b146d4fac4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:06.805183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9ccfd-73d9-4f5c-8468-12495549299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:06.806196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9ccfd-73d9-4f5c-8468-12495549299d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:06.806696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9ccfd-73d9-4f5c-8468-12495549299d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:06.807166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9ccfd-73d9-4f5c-8468-12495549299d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:06.819984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9ccfd-73d9-4f5c-8468-12495549299d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9bc9ccfd-73d9-4f5c-8468-12495549299d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:06.826382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:06.827317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:06.828108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:06.831114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 66/129] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:06.836990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9ccfd-73d9-4f5c-8468-12495549299d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:06.875834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:06.916767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:06.977342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9ccfd-73d9-4f5c-8468-12495549299d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:07.024780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e2ad7-0ebf-4ac1-9117-a8062e0464e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:07.025790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e2ad7-0ebf-4ac1-9117-a8062e0464e8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.026225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e2ad7-0ebf-4ac1-9117-a8062e0464e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.026649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e2ad7-0ebf-4ac1-9117-a8062e0464e8 None admin] PATH_INFO: `/v3/projects/a75c8c3d3f5848ae8c7f13da5976da51` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.028104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e2ad7-0ebf-4ac1-9117-a8062e0464e8 None admin] RBAC: Authorizing `identity:get_project(project_id=a75c8c3d3f5848ae8c7f13da5976da51)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:07.029814 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e2ad7-0ebf-4ac1-9117-a8062e0464e8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:07.032102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 67/130] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:06 2022] GET /identity/v3/projects/a75c8c3d3f5848ae8c7f13da5976da51 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:07.033079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e2ad7-0ebf-4ac1-9117-a8062e0464e8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:07.044915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72072c8-1486-4b98-ad7f-71b146d4fac4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:07.111426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11fa12-ba5e-4f83-bd06-3fca4ed87598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:07.112650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11fa12-ba5e-4f83-bd06-3fca4ed87598 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.113351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11fa12-ba5e-4f83-bd06-3fca4ed87598 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.114788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11fa12-ba5e-4f83-bd06-3fca4ed87598 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.117791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11fa12-ba5e-4f83-bd06-3fca4ed87598 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:07.120123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11fa12-ba5e-4f83-bd06-3fca4ed87598 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:07.122306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 64/131] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:06 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:07.123220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11fa12-ba5e-4f83-bd06-3fca4ed87598 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:07.205030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e2ad7-0ebf-4ac1-9117-a8062e0464e8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:07.245094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:07.257856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64ef1b-9473-4626-85e2-dac1be16fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:07.263421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64ef1b-9473-4626-85e2-dac1be16fe99 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.263421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64ef1b-9473-4626-85e2-dac1be16fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.263421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64ef1b-9473-4626-85e2-dac1be16fe99 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.263421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64ef1b-9473-4626-85e2-dac1be16fe99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:07.263421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64ef1b-9473-4626-85e2-dac1be16fe99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:07.263856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64ef1b-9473-4626-85e2-dac1be16fe99 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:07.265375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11fa12-ba5e-4f83-bd06-3fca4ed87598 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:07.275169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:07.277933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 68/132] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:07.279970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99c29-b563-4c6a-866a-a1f4b18a7a20 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.280344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99c29-b563-4c6a-866a-a1f4b18a7a20 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.280723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99c29-b563-4c6a-866a-a1f4b18a7a20 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.287731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 69/133] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:07.288794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99c29-b563-4c6a-866a-a1f4b18a7a20 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:07.311637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ff9dc-1d94-4f80-b766-d81c9da1a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:07.312780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff9dc-1d94-4f80-b766-d81c9da1a300 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.313343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff9dc-1d94-4f80-b766-d81c9da1a300 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.313826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff9dc-1d94-4f80-b766-d81c9da1a300 None admin] PATH_INFO: `/v3/projects/a75c8c3d3f5848ae8c7f13da5976da51/users/0db8cbec685146f29926d156e74d541f/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.316421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ff9dc-1d94-4f80-b766-d81c9da1a300 None admin] RBAC: Authorizing `identity:create_grant(project_id=a75c8c3d3f5848ae8c7f13da5976da51, user_id=0db8cbec685146f29926d156e74d541f, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:07.318103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ff9dc-1d94-4f80-b766-d81c9da1a300 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:07.338671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 65/134] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:07 2022] PUT /identity/v3/projects/a75c8c3d3f5848ae8c7f13da5976da51/users/0db8cbec685146f29926d156e74d541f/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:07.340117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ff9dc-1d94-4f80-b766-d81c9da1a300 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:07.511976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ff9dc-1d94-4f80-b766-d81c9da1a300 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:07.534903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99c29-b563-4c6a-866a-a1f4b18a7a20 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:07.559470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bee13-8b3d-4e74-a0e8-7acb9cddc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:07.560538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bee13-8b3d-4e74-a0e8-7acb9cddc666 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.560842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bee13-8b3d-4e74-a0e8-7acb9cddc666 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.561123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bee13-8b3d-4e74-a0e8-7acb9cddc666 None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.562344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bee13-8b3d-4e74-a0e8-7acb9cddc666 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:07.563879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bee13-8b3d-4e74-a0e8-7acb9cddc666 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:07.566548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 66/135] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:07 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:07.568023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f5a1-a7f9-41fe-8110-a0f07e58ebf9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.568329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f5a1-a7f9-41fe-8110-a0f07e58ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.568599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f5a1-a7f9-41fe-8110-a0f07e58ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.592240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66dda0-f6dc-416b-ad2f-959f29f75b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:07.593311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66dda0-f6dc-416b-ad2f-959f29f75b44 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.593797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66dda0-f6dc-416b-ad2f-959f29f75b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.594285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66dda0-f6dc-416b-ad2f-959f29f75b44 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093/users/0db8cbec685146f29926d156e74d541f/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.597682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66dda0-f6dc-416b-ad2f-959f29f75b44 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e31d30c684107b874c500626aa093, user_id=0db8cbec685146f29926d156e74d541f, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:07.600648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66dda0-f6dc-416b-ad2f-959f29f75b44 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:07.607600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ef60f5a1-a7f9-41fe-8110-a0f07e58ebf9 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:07.609222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ef60f5a1-a7f9-41fe-8110-a0f07e58ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:07.629981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 70/136] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:07 2022] PUT /identity/v3/projects/fc7e31d30c684107b874c500626aa093/users/0db8cbec685146f29926d156e74d541f/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:07.631318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66dda0-f6dc-416b-ad2f-959f29f75b44 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:07.700696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:07.726769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:07.786905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66dda0-f6dc-416b-ad2f-959f29f75b44 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:07.839401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 67/137] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:07.840848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0897d4-7092-4c59-ae3d-f86926c8f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:07.841635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0897d4-7092-4c59-ae3d-f86926c8f021 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:07.841932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0897d4-7092-4c59-ae3d-f86926c8f021 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:07.842237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0897d4-7092-4c59-ae3d-f86926c8f021 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:07.844161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0897d4-7092-4c59-ae3d-f86926c8f021 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:07.845628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0897d4-7092-4c59-ae3d-f86926c8f021 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:07.847473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 71/138] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:07 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:07.856281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f5a1-a7f9-41fe-8110-a0f07e58ebf9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:07.863639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0897d4-7092-4c59-ae3d-f86926c8f021 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:08.025133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f5a1-a7f9-41fe-8110-a0f07e58ebf9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:08.044559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0897d4-7092-4c59-ae3d-f86926c8f021 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:08.074892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:08.089112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedab59-d6ba-45d6-93fe-2c6d94a87263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:08.089829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedab59-d6ba-45d6-93fe-2c6d94a87263 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.090449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedab59-d6ba-45d6-93fe-2c6d94a87263 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.090788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedab59-d6ba-45d6-93fe-2c6d94a87263 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093/users/0db8cbec685146f29926d156e74d541f/roles/a3cb41ec3a524b60bc728cd4b0ab78e0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.093360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedab59-d6ba-45d6-93fe-2c6d94a87263 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e31d30c684107b874c500626aa093, user_id=0db8cbec685146f29926d156e74d541f, role_id=a3cb41ec3a524b60bc728cd4b0ab78e0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:08.095054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedab59-d6ba-45d6-93fe-2c6d94a87263 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:08.096611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090900e1-efd7-48e6-a080-eab155045b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:08.097731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090900e1-efd7-48e6-a080-eab155045b13 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.098297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090900e1-efd7-48e6-a080-eab155045b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.098874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090900e1-efd7-48e6-a080-eab155045b13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.100723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090900e1-efd7-48e6-a080-eab155045b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:08.102750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090900e1-efd7-48e6-a080-eab155045b13 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:08.105202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 72/139] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:08.114901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090900e1-efd7-48e6-a080-eab155045b13 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:08.127959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 68/140] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:07 2022] PUT /identity/v3/projects/fc7e31d30c684107b874c500626aa093/users/0db8cbec685146f29926d156e74d541f/roles/a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:08.157112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390c49-c128-43af-b8ae-dc2e38bb5913 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.158867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390c49-c128-43af-b8ae-dc2e38bb5913 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.158867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390c49-c128-43af-b8ae-dc2e38bb5913 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.164552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 69/141] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:08.172678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa0744-eed2-405c-9a68-43485d102e31 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.173005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa0744-eed2-405c-9a68-43485d102e31 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.173313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa0744-eed2-405c-9a68-43485d102e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.223661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-12fa0744-eed2-405c-9a68-43485d102e31 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:08.224932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-12fa0744-eed2-405c-9a68-43485d102e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:08.282639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:08.408277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090900e1-efd7-48e6-a080-eab155045b13 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:08.428501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 70/142] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:08.471695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db540-9ec5-404a-9714-51eb252bf37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:08.472336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db540-9ec5-404a-9714-51eb252bf37e None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.472619 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db540-9ec5-404a-9714-51eb252bf37e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.472895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db540-9ec5-404a-9714-51eb252bf37e None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.473590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db540-9ec5-404a-9714-51eb252bf37e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:08.475055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db540-9ec5-404a-9714-51eb252bf37e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:08.483831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa0744-eed2-405c-9a68-43485d102e31 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:08.519602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 73/143] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:08 2022] POST /identity/v3/users => generated 283 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:08.617709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa0744-eed2-405c-9a68-43485d102e31 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:08.626132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208594-a5f5-4f98-8882-ada441a134df None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.627190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208594-a5f5-4f98-8882-ada441a134df None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.627719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208594-a5f5-4f98-8882-ada441a134df None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.629451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 74/144] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:08.635806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6d12-0ba5-4fe6-8605-8acef2e0a716 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.636489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6d12-0ba5-4fe6-8605-8acef2e0a716 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.636966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6d12-0ba5-4fe6-8605-8acef2e0a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.657705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1c4d6d12-0ba5-4fe6-8605-8acef2e0a716 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:08.659444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c4d6d12-0ba5-4fe6-8605-8acef2e0a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:08.663592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013b798-bcae-4b5a-9e1d-57095c5aa1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:08.663872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b798-bcae-4b5a-9e1d-57095c5aa1ee None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.664075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b798-bcae-4b5a-9e1d-57095c5aa1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.664621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b798-bcae-4b5a-9e1d-57095c5aa1ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.680018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013b798-bcae-4b5a-9e1d-57095c5aa1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9013b798-bcae-4b5a-9e1d-57095c5aa1ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:08.685077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:08.685884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:08.686623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 71/145] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:08.694261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013b798-bcae-4b5a-9e1d-57095c5aa1ee None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:08.734736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:08.738287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:08.803875 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 75/146] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:08.826026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d6d12-0ba5-4fe6-8605-8acef2e0a716 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:08.850620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013b798-bcae-4b5a-9e1d-57095c5aa1ee None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:08.910532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:08.911061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:08.911343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:08.911632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:08.913984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:08.914566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:08.916022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:08.935804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 72/147] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:08.943449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:09.010991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d6d12-0ba5-4fe6-8605-8acef2e0a716 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:09.058254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a42d9-6023-4fee-b519-39a6503aa328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:09.058919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a42d9-6023-4fee-b519-39a6503aa328 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:09.059201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a42d9-6023-4fee-b519-39a6503aa328 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:09.060348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a42d9-6023-4fee-b519-39a6503aa328 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:09.084130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a42d9-6023-4fee-b519-39a6503aa328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cc1a42d9-6023-4fee-b519-39a6503aa328 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:09.096792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:09.100518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 76/148] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:23:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:09.108874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a42d9-6023-4fee-b519-39a6503aa328 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:09.111901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:09.156386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a135c-2ad5-438a-85d9-433344ff9c13 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:09.168502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:09.248718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f40e67-f66f-48c0-aeed-f9b01c1989d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:09.249397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40e67-f66f-48c0-aeed-f9b01c1989d1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:09.249682 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40e67-f66f-48c0-aeed-f9b01c1989d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:09.249962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40e67-f66f-48c0-aeed-f9b01c1989d1 None admin] PATH_INFO: `/v3/users/b4ceaa3593324e618949bc826b95c8a7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:09.251142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40e67-f66f-48c0-aeed-f9b01c1989d1 None admin] RBAC: Authorizing `identity:get_user(user_id=b4ceaa3593324e618949bc826b95c8a7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:09.252854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40e67-f66f-48c0-aeed-f9b01c1989d1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:09.254906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 73/149] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:08 2022] GET /identity/v3/users/b4ceaa3593324e618949bc826b95c8a7 => generated 289 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:09.255192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a42d9-6023-4fee-b519-39a6503aa328 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:09.264397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f40e67-f66f-48c0-aeed-f9b01c1989d1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:09.299318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:09.300017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:09.300302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:09.300630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:09.301736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:09.302051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:09.303535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:09.313467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 77/150] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:09.319357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:09.433747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3f5f0-ec22-4fc8-b224-f02c9d647169 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:09.451288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:09.488933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bb03-0517-4dc5-a5ba-f846fd7bfd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:09.489967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bb03-0517-4dc5-a5ba-f846fd7bfd60 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:09.490325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bb03-0517-4dc5-a5ba-f846fd7bfd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:09.490660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bb03-0517-4dc5-a5ba-f846fd7bfd60 None admin] PATH_INFO: `/v3/users/4dac00d0ca0d4081a88ccba053ac2218` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:09.493629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98bb03-0517-4dc5-a5ba-f846fd7bfd60 None admin] RBAC: Authorizing `identity:get_user(user_id=4dac00d0ca0d4081a88ccba053ac2218)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:09.495366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98bb03-0517-4dc5-a5ba-f846fd7bfd60 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:09.497512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 78/151] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:09 2022] GET /identity/v3/users/4dac00d0ca0d4081a88ccba053ac2218 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:09.503129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bb03-0517-4dc5-a5ba-f846fd7bfd60 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:09.618287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bb03-0517-4dc5-a5ba-f846fd7bfd60 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:09.657072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8382fc-c2b3-4974-b957-d43d0eb0e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:09.657964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8382fc-c2b3-4974-b957-d43d0eb0e01b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:09.657964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8382fc-c2b3-4974-b957-d43d0eb0e01b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:09.658403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8382fc-c2b3-4974-b957-d43d0eb0e01b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:09.698316 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f40e67-f66f-48c0-aeed-f9b01c1989d1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:09.699635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:09.744500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8382fc-c2b3-4974-b957-d43d0eb0e01b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:09.746141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8382fc-c2b3-4974-b957-d43d0eb0e01b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:09.859697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 79/152] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:09.861810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b298a-06dc-4261-ac8b-78cee950d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:09.862815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b298a-06dc-4261-ac8b-78cee950d51e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:09.863278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b298a-06dc-4261-ac8b-78cee950d51e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:09.863757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b298a-06dc-4261-ac8b-78cee950d51e None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:09.865594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b298a-06dc-4261-ac8b-78cee950d51e None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:09.865876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8382fc-c2b3-4974-b957-d43d0eb0e01b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:09.868225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b298a-06dc-4261-ac8b-78cee950d51e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:09.871068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 74/153] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:09 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 607 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:09.882415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b298a-06dc-4261-ac8b-78cee950d51e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:09.938616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:09.964162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:10.003944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8382fc-c2b3-4974-b957-d43d0eb0e01b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:10.046192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130117f-1cbd-453c-b970-7efdf40a6bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:10.046848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130117f-1cbd-453c-b970-7efdf40a6bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:10.047193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130117f-1cbd-453c-b970-7efdf40a6bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:10.047591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130117f-1cbd-453c-b970-7efdf40a6bb9 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:10.048802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130117f-1cbd-453c-b970-7efdf40a6bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:10.050899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130117f-1cbd-453c-b970-7efdf40a6bb9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:10.052947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 80/154] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:09 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:10.059494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130117f-1cbd-453c-b970-7efdf40a6bb9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:10.181195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130117f-1cbd-453c-b970-7efdf40a6bb9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:10.214962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b298a-06dc-4261-ac8b-78cee950d51e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:10.219834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3fcf2-33c1-42dd-8e5f-a61e3e14ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:10.220476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3fcf2-33c1-42dd-8e5f-a61e3e14ba04 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:10.220756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3fcf2-33c1-42dd-8e5f-a61e3e14ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:10.221558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3fcf2-33c1-42dd-8e5f-a61e3e14ba04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:10.227670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:10.228955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3fcf2-33c1-42dd-8e5f-a61e3e14ba04 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=fc7e31d30c684107b874c500626aa093, user.id=4dac00d0ca0d4081a88ccba053ac2218) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:10.229872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3fcf2-33c1-42dd-8e5f-a61e3e14ba04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:10.232793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3fcf2-33c1-42dd-8e5f-a61e3e14ba04 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:10.247737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 81/155] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:10 2022] GET /identity/v3/role_assignments?user.id=4dac00d0ca0d4081a88ccba053ac2218&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=7a7079c0864e4bb7acaa71238097426e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:10.324625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f870-4a77-43fc-b8b9-1752eb35410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:10.325761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f870-4a77-43fc-b8b9-1752eb35410f None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:10.326252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f870-4a77-43fc-b8b9-1752eb35410f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:10.326726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f870-4a77-43fc-b8b9-1752eb35410f None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093/users/b4ceaa3593324e618949bc826b95c8a7/roles/c31070d0b9f143a49945c541a812a52e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:10.330301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282f870-4a77-43fc-b8b9-1752eb35410f None admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e31d30c684107b874c500626aa093, user_id=b4ceaa3593324e618949bc826b95c8a7, role_id=c31070d0b9f143a49945c541a812a52e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:10.333092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282f870-4a77-43fc-b8b9-1752eb35410f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:10.358896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 75/156] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:09 2022] PUT /identity/v3/projects/fc7e31d30c684107b874c500626aa093/users/b4ceaa3593324e618949bc826b95c8a7/roles/c31070d0b9f143a49945c541a812a52e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:10.539709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076b94-0f41-4c3d-9d41-31ff81018838 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:10.539978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076b94-0f41-4c3d-9d41-31ff81018838 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:10.540452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076b94-0f41-4c3d-9d41-31ff81018838 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:10.542775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 82/157] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:10.553956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449d91-1e69-4598-a7c5-23c9da4f0866 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:10.555012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449d91-1e69-4598-a7c5-23c9da4f0866 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:10.555443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449d91-1e69-4598-a7c5-23c9da4f0866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:10.601204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-33449d91-1e69-4598-a7c5-23c9da4f0866 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:10.603108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-33449d91-1e69-4598-a7c5-23c9da4f0866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:10.764788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 76/158] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:10.806606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3076b94-0f41-4c3d-9d41-31ff81018838 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:10.954203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3076b94-0f41-4c3d-9d41-31ff81018838 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:10.993490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c7f1-d198-4bd7-b563-452f8a2ae5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:10.994345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c7f1-d198-4bd7-b563-452f8a2ae5dd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:10.994630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c7f1-d198-4bd7-b563-452f8a2ae5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:10.994906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c7f1-d198-4bd7-b563-452f8a2ae5dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:11.008286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378c7f1-d198-4bd7-b563-452f8a2ae5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e378c7f1-d198-4bd7-b563-452f8a2ae5dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:11.014051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:11.016131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:11.017997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 83/159] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:11.022812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33449d91-1e69-4598-a7c5-23c9da4f0866 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:11.026933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:11.272547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33449d91-1e69-4598-a7c5-23c9da4f0866 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:11.334828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:11.336707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:11.337391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:11.338054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:11.339624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:11.340354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:11.342858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:11.359727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 77/160] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:11.367424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c7f1-d198-4bd7-b563-452f8a2ae5dd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:11.451580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:11.518703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c7f1-d198-4bd7-b563-452f8a2ae5dd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:11.566468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fe178-419d-44ac-abbf-5b8a4219a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:11.567163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe178-419d-44ac-abbf-5b8a4219a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:11.567477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe178-419d-44ac-abbf-5b8a4219a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:11.567760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe178-419d-44ac-abbf-5b8a4219a5c5 None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:11.568984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fe178-419d-44ac-abbf-5b8a4219a5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:11.571012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fe178-419d-44ac-abbf-5b8a4219a5c5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:11.573065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 84/161] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:11 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:11.585121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:11.685851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:11.735240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122341-b0f5-4bfd-a796-0f14450ae28d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:11.786042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf8775-2ba4-4b49-88ea-cf874088918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:11.787511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf8775-2ba4-4b49-88ea-cf874088918d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:11.788090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf8775-2ba4-4b49-88ea-cf874088918d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:11.788568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf8775-2ba4-4b49-88ea-cf874088918d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:11.901830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf8775-2ba4-4b49-88ea-cf874088918d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:11.909278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf8775-2ba4-4b49-88ea-cf874088918d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:12.032437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:12.096327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 78/162] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:12.102425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fe178-419d-44ac-abbf-5b8a4219a5c5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:12.266143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fe178-419d-44ac-abbf-5b8a4219a5c5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:12.298958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:12.316723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a006-b267-43ee-8a81-d55f3f81721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:12.317437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a006-b267-43ee-8a81-d55f3f81721b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:12.317729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a006-b267-43ee-8a81-d55f3f81721b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:12.318011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a006-b267-43ee-8a81-d55f3f81721b None admin] PATH_INFO: `/v3/projects/a75c8c3d3f5848ae8c7f13da5976da51` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:12.319226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85a006-b267-43ee-8a81-d55f3f81721b None admin] RBAC: Authorizing `identity:get_project(project_id=a75c8c3d3f5848ae8c7f13da5976da51)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:12.321708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85a006-b267-43ee-8a81-d55f3f81721b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:12.324845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 85/163] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:12 2022] GET /identity/v3/projects/a75c8c3d3f5848ae8c7f13da5976da51 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:12.332539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf8775-2ba4-4b49-88ea-cf874088918d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:12.446296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09196-c7df-43ab-9bee-202d6ff0ed8e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:12.446597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09196-c7df-43ab-9bee-202d6ff0ed8e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:12.446789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09196-c7df-43ab-9bee-202d6ff0ed8e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:12.448167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 86/164] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:12.453549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2811d-5ce3-4b07-b9a6-3dab62c04caa None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:12.453831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2811d-5ce3-4b07-b9a6-3dab62c04caa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:12.454109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2811d-5ce3-4b07-b9a6-3dab62c04caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:12.478146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4dd2811d-5ce3-4b07-b9a6-3dab62c04caa None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:12.479343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf8775-2ba4-4b49-88ea-cf874088918d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:12.479572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4dd2811d-5ce3-4b07-b9a6-3dab62c04caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:12.585974 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b052a6-b134-49f4-b237-b75438b887b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:12.587108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b052a6-b134-49f4-b237-b75438b887b1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:12.588195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b052a6-b134-49f4-b237-b75438b887b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:12.588841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b052a6-b134-49f4-b237-b75438b887b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:12.590953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b052a6-b134-49f4-b237-b75438b887b1 None admin] RBAC: Adding query filter params (role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=a75c8c3d3f5848ae8c7f13da5976da51, user.id=0db8cbec685146f29926d156e74d541f) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:12.591706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b052a6-b134-49f4-b237-b75438b887b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:12.594798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b052a6-b134-49f4-b237-b75438b887b1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:12.608132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 79/165] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:12 2022] GET /identity/v3/role_assignments?user.id=0db8cbec685146f29926d156e74d541f&scope.project.id=a75c8c3d3f5848ae8c7f13da5976da51&role.id=cb911cef057e44fb9c8004a419568df8 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:12.609748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68597-563c-4500-a9f2-f1109abaefd7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:12.610232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68597-563c-4500-a9f2-f1109abaefd7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:12.610985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68597-563c-4500-a9f2-f1109abaefd7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:12.619006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 80/166] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:12.629400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae70c9-8690-477a-951d-2486205e302f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:12.630058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae70c9-8690-477a-951d-2486205e302f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:12.630538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae70c9-8690-477a-951d-2486205e302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:12.655399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 87/167] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:12.667310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-78ae70c9-8690-477a-951d-2486205e302f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:12.668889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-78ae70c9-8690-477a-951d-2486205e302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:12.707814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:12.765370 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2811d-5ce3-4b07-b9a6-3dab62c04caa None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:12.797871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 81/168] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:12.851411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae70c9-8690-477a-951d-2486205e302f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:12.957664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2811d-5ce3-4b07-b9a6-3dab62c04caa None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:12.993820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:13.015139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae70c9-8690-477a-951d-2486205e302f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:13.016147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2bf8f-36fa-415a-a0b5-1de96469c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:13.016921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2bf8f-36fa-415a-a0b5-1de96469c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:13.017338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2bf8f-36fa-415a-a0b5-1de96469c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:13.017788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2bf8f-36fa-415a-a0b5-1de96469c0a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:13.033214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2bf8f-36fa-415a-a0b5-1de96469c0a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-bbb2bf8f-36fa-415a-a0b5-1de96469c0a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:13.038488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:13.039944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:13.040750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:13.046209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 88/169] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:13.055028 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2bf8f-36fa-415a-a0b5-1de96469c0a4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:13.068613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47fec0-c2b8-4e6b-b851-f997b39f8670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:13.069638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47fec0-c2b8-4e6b-b851-f997b39f8670 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:13.070651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47fec0-c2b8-4e6b-b851-f997b39f8670 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:13.071100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47fec0-c2b8-4e6b-b851-f997b39f8670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:13.085544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47fec0-c2b8-4e6b-b851-f997b39f8670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ab47fec0-c2b8-4e6b-b851-f997b39f8670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:13.091884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:13.092967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:13.093880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:13.097030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 82/170] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:13.104563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47fec0-c2b8-4e6b-b851-f997b39f8670 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:13.128547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:13.229180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47fec0-c2b8-4e6b-b851-f997b39f8670 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:13.268405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2bf8f-36fa-415a-a0b5-1de96469c0a4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:13.285920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:13.288916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:13.289726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:13.290196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:13.291208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:13.291745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:13.294534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:13.322532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 83/171] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:13.330785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:13.359515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:13.360521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:13.362174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:13.364282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:13.365219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:13.365743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:13.367976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:13.390668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 89/172] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:13.398877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:13.503979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:13.508900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:13.575964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb70eca-31dd-4461-8a42-c1fc3d304433 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:13.601330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8cdf9-06a2-4c3a-8165-8b096a1db010 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:13.652362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813193-4ba6-4ffe-8321-697032fa9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:13.653437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813193-4ba6-4ffe-8321-697032fa9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:13.653924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813193-4ba6-4ffe-8321-697032fa9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:13.654416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813193-4ba6-4ffe-8321-697032fa9fa3 None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:13.656030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec813193-4ba6-4ffe-8321-697032fa9fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:13.657812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec813193-4ba6-4ffe-8321-697032fa9fa3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:13.664011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 90/173] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:13 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:13.665514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533c3f-839c-4fa4-8d4d-674adc75c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:13.666303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533c3f-839c-4fa4-8d4d-674adc75c98e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:13.666586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533c3f-839c-4fa4-8d4d-674adc75c98e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:13.666858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533c3f-839c-4fa4-8d4d-674adc75c98e None admin] PATH_INFO: `/v3/users/0db8cbec685146f29926d156e74d541f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:13.667882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813193-4ba6-4ffe-8321-697032fa9fa3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:13.668329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5533c3f-839c-4fa4-8d4d-674adc75c98e None admin] RBAC: Authorizing `identity:get_user(user_id=0db8cbec685146f29926d156e74d541f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:13.669915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5533c3f-839c-4fa4-8d4d-674adc75c98e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:13.671825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 84/174] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:13 2022] GET /identity/v3/users/0db8cbec685146f29926d156e74d541f => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:13.676962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533c3f-839c-4fa4-8d4d-674adc75c98e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:13.842228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813193-4ba6-4ffe-8321-697032fa9fa3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:13.860549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:13.878355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533c3f-839c-4fa4-8d4d-674adc75c98e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:13.916186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64051f9-3de3-4fd5-a6ca-417f7943d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:13.916833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64051f9-3de3-4fd5-a6ca-417f7943d0aa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:13.917121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64051f9-3de3-4fd5-a6ca-417f7943d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:13.917392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64051f9-3de3-4fd5-a6ca-417f7943d0aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:13.930349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d73b4-ff3f-4e5d-ae89-6df7c2b8b6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:13.931407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d73b4-ff3f-4e5d-ae89-6df7c2b8b6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:13.931918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d73b4-ff3f-4e5d-ae89-6df7c2b8b6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:13.932394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d73b4-ff3f-4e5d-ae89-6df7c2b8b6e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:13.954809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:14.021400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d73b4-ff3f-4e5d-ae89-6df7c2b8b6e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:14.022141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64051f9-3de3-4fd5-a6ca-417f7943d0aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:14.024325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d73b4-ff3f-4e5d-ae89-6df7c2b8b6e9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:14.033092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64051f9-3de3-4fd5-a6ca-417f7943d0aa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:14.149507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 85/175] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:14.151435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06525-da7d-4259-b6aa-d714573aaf95 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.151952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06525-da7d-4259-b6aa-d714573aaf95 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.152430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06525-da7d-4259-b6aa-d714573aaf95 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.154209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 86/176] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:14.164809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b72c-42aa-42b1-8a35-a8ac2fcc18f0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.165458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b72c-42aa-42b1-8a35-a8ac2fcc18f0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.165989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b72c-42aa-42b1-8a35-a8ac2fcc18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.186135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d712b72c-42aa-42b1-8a35-a8ac2fcc18f0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:14.187707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d712b72c-42aa-42b1-8a35-a8ac2fcc18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:14.207645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 91/177] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:14.208858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64051f9-3de3-4fd5-a6ca-417f7943d0aa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:14.227269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:14.253177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:14.282203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 87/178] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:14.283862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712b72c-42aa-42b1-8a35-a8ac2fcc18f0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:14.373105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64051f9-3de3-4fd5-a6ca-417f7943d0aa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:14.423152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712b72c-42aa-42b1-8a35-a8ac2fcc18f0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:14.429748 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6763-1f45-4616-b9d7-971abda87665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:14.430440 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6763-1f45-4616-b9d7-971abda87665 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.430717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6763-1f45-4616-b9d7-971abda87665 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.430986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6763-1f45-4616-b9d7-971abda87665 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.432274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6763-1f45-4616-b9d7-971abda87665 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:14.433734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6763-1f45-4616-b9d7-971abda87665 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:14.440335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 92/179] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:14 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:14.440335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31c0d4-5769-4533-ae45-872cec245e2b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.440335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31c0d4-5769-4533-ae45-872cec245e2b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.440335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31c0d4-5769-4533-ae45-872cec245e2b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.440335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 93/180] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:14.440335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31c0d4-5769-4533-ae45-872cec245e2b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:14.477964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727166d8-2d49-4875-b889-7ee374f428b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:14.478794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727166d8-2d49-4875-b889-7ee374f428b5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.479176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727166d8-2d49-4875-b889-7ee374f428b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.479569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727166d8-2d49-4875-b889-7ee374f428b5 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.480808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727166d8-2d49-4875-b889-7ee374f428b5 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:14.482255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727166d8-2d49-4875-b889-7ee374f428b5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:14.483958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 88/181] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:14 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:14.485144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685da28-4368-4fbc-8838-79a0ceea1a9e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.485426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685da28-4368-4fbc-8838-79a0ceea1a9e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.485703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685da28-4368-4fbc-8838-79a0ceea1a9e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.487236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 89/182] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:14.492638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685da28-4368-4fbc-8838-79a0ceea1a9e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:14.546643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:14.554779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:14.577675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31c0d4-5769-4533-ae45-872cec245e2b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:14.608876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685da28-4368-4fbc-8838-79a0ceea1a9e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:14.615556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00640a-f14f-4da8-b61f-bc025b6592cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:14.616204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00640a-f14f-4da8-b61f-bc025b6592cd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.616481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00640a-f14f-4da8-b61f-bc025b6592cd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.616752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00640a-f14f-4da8-b61f-bc025b6592cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.628191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00640a-f14f-4da8-b61f-bc025b6592cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ac00640a-f14f-4da8-b61f-bc025b6592cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:14.633771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:14.634636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:14.635457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 94/183] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:14.636159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfa426-6010-4313-b417-48e71f0be94b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.637027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfa426-6010-4313-b417-48e71f0be94b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.637027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfa426-6010-4313-b417-48e71f0be94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.652246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5fe2b-6c6d-4fca-9eef-370137574d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:14.653138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5fe2b-6c6d-4fca-9eef-370137574d30 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.653391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5fe2b-6c6d-4fca-9eef-370137574d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.653663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5fe2b-6c6d-4fca-9eef-370137574d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.654456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5fe2b-6c6d-4fca-9eef-370137574d30 None admin] RBAC: Adding query filter params (role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=fc7e31d30c684107b874c500626aa093, user.id=0db8cbec685146f29926d156e74d541f) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:14.654764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5fe2b-6c6d-4fca-9eef-370137574d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:14.656278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5fe2b-6c6d-4fca-9eef-370137574d30 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:14.656382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-63bfa426-6010-4313-b417-48e71f0be94b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:14.657502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-63bfa426-6010-4313-b417-48e71f0be94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:14.662362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 90/184] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:14 2022] GET /identity/v3/role_assignments?user.id=0db8cbec685146f29926d156e74d541f&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=cb911cef057e44fb9c8004a419568df8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:14.665014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6840d77-508a-45fc-902c-42f7b66bacfb None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.665453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6840d77-508a-45fc-902c-42f7b66bacfb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.666348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6840d77-508a-45fc-902c-42f7b66bacfb None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.671327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 91/185] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:14.671327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6840d77-508a-45fc-902c-42f7b66bacfb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:14.754223 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 95/186] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:14.755482 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56615ff-750c-423d-9df5-c655cf0b57e1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.755772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56615ff-750c-423d-9df5-c655cf0b57e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.756048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56615ff-750c-423d-9df5-c655cf0b57e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.776558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e56615ff-750c-423d-9df5-c655cf0b57e1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:14.777785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e56615ff-750c-423d-9df5-c655cf0b57e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:14.846832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6840d77-508a-45fc-902c-42f7b66bacfb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:14.862271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:14.883694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:14.891462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 96/187] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:14.892929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56615ff-750c-423d-9df5-c655cf0b57e1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:14.893421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dce388-e851-4200-8adf-52dcd8fa3429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:14.894113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce388-e851-4200-8adf-52dcd8fa3429 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.894326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce388-e851-4200-8adf-52dcd8fa3429 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.894603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce388-e851-4200-8adf-52dcd8fa3429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.896434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dce388-e851-4200-8adf-52dcd8fa3429 None admin] RBAC: Adding query filter params (role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=fc7e31d30c684107b874c500626aa093, user.id=0db8cbec685146f29926d156e74d541f) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:14.896434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dce388-e851-4200-8adf-52dcd8fa3429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:14.897216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dce388-e851-4200-8adf-52dcd8fa3429 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:14.905006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 92/188] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:14 2022] GET /identity/v3/role_assignments?user.id=0db8cbec685146f29926d156e74d541f&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:14.906391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfdc8-b3d9-43b8-ab2a-22610da8014a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:14.906683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfdc8-b3d9-43b8-ab2a-22610da8014a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:14.906961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfdc8-b3d9-43b8-ab2a-22610da8014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:14.928502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3e3bfdc8-b3d9-43b8-ab2a-22610da8014a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:14.930321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3e3bfdc8-b3d9-43b8-ab2a-22610da8014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:15.029144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 93/189] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:15.030015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfdc8-b3d9-43b8-ab2a-22610da8014a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.053938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56615ff-750c-423d-9df5-c655cf0b57e1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.102802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.103514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.103803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.104081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:15.104813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:15.105117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:15.106503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:15.117048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 97/190] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:15.117906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.161526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfdc8-b3d9-43b8-ab2a-22610da8014a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.164728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:15.203458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:15.211332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56eef-a4ab-43c1-bcf7-04d180b6e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.212189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56eef-a4ab-43c1-bcf7-04d180b6e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.212467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56eef-a4ab-43c1-bcf7-04d180b6e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.212750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56eef-a4ab-43c1-bcf7-04d180b6e5d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:15.213912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d56eef-a4ab-43c1-bcf7-04d180b6e5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:15.215413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d56eef-a4ab-43c1-bcf7-04d180b6e5d2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:15.217045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 94/191] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:15.217806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56eef-a4ab-43c1-bcf7-04d180b6e5d2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.251437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd3951-f266-4a8b-9de0-63058072e15e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.291771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb466b9-e607-44da-8ce7-c6dae8d1db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.292334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb466b9-e607-44da-8ce7-c6dae8d1db98 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.292620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb466b9-e607-44da-8ce7-c6dae8d1db98 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.292899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb466b9-e607-44da-8ce7-c6dae8d1db98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:15.314300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb466b9-e607-44da-8ce7-c6dae8d1db98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7cb466b9-e607-44da-8ce7-c6dae8d1db98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:15.320877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:15.321932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:15.322682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 98/192] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:15.323323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb466b9-e607-44da-8ce7-c6dae8d1db98 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.333185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56eef-a4ab-43c1-bcf7-04d180b6e5d2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.371892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf345e-3d1d-4f31-a4d1-4270f10408a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.372556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf345e-3d1d-4f31-a4d1-4270f10408a1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.373133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf345e-3d1d-4f31-a4d1-4270f10408a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.373133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf345e-3d1d-4f31-a4d1-4270f10408a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:15.384157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf345e-3d1d-4f31-a4d1-4270f10408a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-fedf345e-3d1d-4f31-a4d1-4270f10408a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:15.389634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:15.390635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:15.391544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 95/193] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:15.392232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf345e-3d1d-4f31-a4d1-4270f10408a1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.426652 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:15.433925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb466b9-e607-44da-8ce7-c6dae8d1db98 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.457015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:15.472371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cf679-5c15-4a91-a93c-603061c1e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.473033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cf679-5c15-4a91-a93c-603061c1e423 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.473321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cf679-5c15-4a91-a93c-603061c1e423 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.473603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cf679-5c15-4a91-a93c-603061c1e423 None admin] PATH_INFO: `/v3/users/d5abf3d41214424293a5fffeb12e74fd` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:15.505221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cf679-5c15-4a91-a93c-603061c1e423 None admin] RBAC: Authorizing `identity:get_user(user_id=d5abf3d41214424293a5fffeb12e74fd)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:15.508237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cf679-5c15-4a91-a93c-603061c1e423 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:15.509128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf345e-3d1d-4f31-a4d1-4270f10408a1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.510095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 99/194] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:15 2022] GET /identity/v3/users/d5abf3d41214424293a5fffeb12e74fd => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:15.512255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cf679-5c15-4a91-a93c-603061c1e423 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.548784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e585ce-b68c-4650-afe4-b4ebefde22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.549321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e585ce-b68c-4650-afe4-b4ebefde22c4 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.549600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e585ce-b68c-4650-afe4-b4ebefde22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.549870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e585ce-b68c-4650-afe4-b4ebefde22c4 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:15.550548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e585ce-b68c-4650-afe4-b4ebefde22c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:15.552045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e585ce-b68c-4650-afe4-b4ebefde22c4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:15.591409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 96/195] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:15 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:15.591409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e585ce-b68c-4650-afe4-b4ebefde22c4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.648455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cf679-5c15-4a91-a93c-603061c1e423 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.697632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.698226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.698514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.698888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:15.699617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:15.700000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:15.701513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:15.713937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 100/196] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:15.714842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.729941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:15.749638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e585ce-b68c-4650-afe4-b4ebefde22c4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.791988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:15.803855 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.805225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.805225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.805225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:15.805801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:15.806330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:15.809985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:15.818463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 97/197] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:15.819189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:15.889511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b443f5-a6dd-4e2d-beff-2591e1851aa2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:15.955129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78df1c5-42c3-49b1-b8fe-ac8dcf51bea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:15.956542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78df1c5-42c3-49b1-b8fe-ac8dcf51bea2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:15.957225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78df1c5-42c3-49b1-b8fe-ac8dcf51bea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:15.957873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78df1c5-42c3-49b1-b8fe-ac8dcf51bea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:16.004675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eda7a-b84e-4a08-8b49-ddb1c224483a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:16.056090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4fc1-001a-4cff-b021-87b114213a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:16.057070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fc1-001a-4cff-b021-87b114213a32 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:16.057507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fc1-001a-4cff-b021-87b114213a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:16.057916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fc1-001a-4cff-b021-87b114213a32 None admin] PATH_INFO: `/v3/users/d5abf3d41214424293a5fffeb12e74fd` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:16.059419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4fc1-001a-4cff-b021-87b114213a32 None admin] RBAC: Authorizing `identity:get_user(user_id=d5abf3d41214424293a5fffeb12e74fd)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:16.061560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4fc1-001a-4cff-b021-87b114213a32 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:16.063804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 98/198] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:15 2022] GET /identity/v3/users/d5abf3d41214424293a5fffeb12e74fd => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:16.065096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4fc1-001a-4cff-b021-87b114213a32 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:16.080097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78df1c5-42c3-49b1-b8fe-ac8dcf51bea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:16.081877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78df1c5-42c3-49b1-b8fe-ac8dcf51bea2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:16.104397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:16.150695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:16.217100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4fc1-001a-4cff-b021-87b114213a32 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:16.239106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 101/199] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:16.243604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78df1c5-42c3-49b1-b8fe-ac8dcf51bea2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:16.289778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adecea1-14ee-4b59-bc3a-c0234433c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:16.290463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adecea1-14ee-4b59-bc3a-c0234433c43c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:16.290744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adecea1-14ee-4b59-bc3a-c0234433c43c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:16.291019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adecea1-14ee-4b59-bc3a-c0234433c43c None admin] PATH_INFO: `/v3/users/b4ceaa3593324e618949bc826b95c8a7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:16.292895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adecea1-14ee-4b59-bc3a-c0234433c43c None admin] RBAC: Authorizing `identity:get_user(user_id=b4ceaa3593324e618949bc826b95c8a7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:16.294861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adecea1-14ee-4b59-bc3a-c0234433c43c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:16.297206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 99/200] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:16 2022] GET /identity/v3/users/b4ceaa3593324e618949bc826b95c8a7 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:16.298425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adecea1-14ee-4b59-bc3a-c0234433c43c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:16.388251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78df1c5-42c3-49b1-b8fe-ac8dcf51bea2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:16.420553 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:16.440451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856148f5-994d-4ef9-a298-533a42ab6f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:16.441575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adecea1-14ee-4b59-bc3a-c0234433c43c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:16.442062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856148f5-994d-4ef9-a298-533a42ab6f0b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:16.442560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856148f5-994d-4ef9-a298-533a42ab6f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:16.443019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856148f5-994d-4ef9-a298-533a42ab6f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:16.464626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:16.496747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186e822-c151-4c8a-bb55-629feaf31761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:16.497956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186e822-c151-4c8a-bb55-629feaf31761 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:16.498437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186e822-c151-4c8a-bb55-629feaf31761 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:16.498902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186e822-c151-4c8a-bb55-629feaf31761 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:16.501072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186e822-c151-4c8a-bb55-629feaf31761 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:16.503856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186e822-c151-4c8a-bb55-629feaf31761 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:16.508961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 100/201] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:16 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:16.510488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186e822-c151-4c8a-bb55-629feaf31761 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:16.554780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856148f5-994d-4ef9-a298-533a42ab6f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:16.557472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856148f5-994d-4ef9-a298-533a42ab6f0b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:16.685051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186e822-c151-4c8a-bb55-629feaf31761 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:16.711734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 102/202] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:16.717219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856148f5-994d-4ef9-a298-533a42ab6f0b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:16.736656 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19757-71a7-4f50-a6f0-da75f1e1c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:16.739007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19757-71a7-4f50-a6f0-da75f1e1c900 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:16.739798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19757-71a7-4f50-a6f0-da75f1e1c900 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:16.740443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19757-71a7-4f50-a6f0-da75f1e1c900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:16.777962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:16.802539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:16.860277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19757-71a7-4f50-a6f0-da75f1e1c900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:16.864251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19757-71a7-4f50-a6f0-da75f1e1c900 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:16.892760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856148f5-994d-4ef9-a298-533a42ab6f0b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:16.952238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:16.953946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:16.954821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:16.955959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:16.957398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5, user.id=d5abf3d41214424293a5fffeb12e74fd) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:16.957784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:16.960151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:16.968589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 103/203] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:16 2022] GET /identity/v3/role_assignments?user.id=d5abf3d41214424293a5fffeb12e74fd&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=7a7079c0864e4bb7acaa71238097426e => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:16.969441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:17.078390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 101/204] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:17.085321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19757-71a7-4f50-a6f0-da75f1e1c900 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:17.177733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dac6b-f580-43ef-b0f6-2a4d48b06dd8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:17.202851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:17.204802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:17.271225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48db49-66cb-46e7-b500-04c29c8ae9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:17.272303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48db49-66cb-46e7-b500-04c29c8ae9ca None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:17.273644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48db49-66cb-46e7-b500-04c29c8ae9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:17.274300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48db49-66cb-46e7-b500-04c29c8ae9ca None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:17.277872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48db49-66cb-46e7-b500-04c29c8ae9ca None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:17.280633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48db49-66cb-46e7-b500-04c29c8ae9ca None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:17.288044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 104/205] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:16 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:17.296231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48db49-66cb-46e7-b500-04c29c8ae9ca None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:17.316800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19757-71a7-4f50-a6f0-da75f1e1c900 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:17.381823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e662b-58d6-40e2-b543-e4b472d853e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:17.389916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e662b-58d6-40e2-b543-e4b472d853e9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:17.390472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e662b-58d6-40e2-b543-e4b472d853e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:17.390925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e662b-58d6-40e2-b543-e4b472d853e9 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:17.392587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e662b-58d6-40e2-b543-e4b472d853e9 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:17.394504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e662b-58d6-40e2-b543-e4b472d853e9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:17.397478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 102/206] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:17 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:17.404598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e662b-58d6-40e2-b543-e4b472d853e9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:17.524142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48db49-66cb-46e7-b500-04c29c8ae9ca None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:17.613256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e662b-58d6-40e2-b543-e4b472d853e9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:17.640599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:17.648002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2e684-c872-4b6d-8750-c2006741c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:17.649618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2e684-c872-4b6d-8750-c2006741c536 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:17.650116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2e684-c872-4b6d-8750-c2006741c536 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:17.650600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2e684-c872-4b6d-8750-c2006741c536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:17.655902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2e684-c872-4b6d-8750-c2006741c536 None admin] RBAC: Adding query filter params (role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5, user.id=d5abf3d41214424293a5fffeb12e74fd) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:17.656457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2e684-c872-4b6d-8750-c2006741c536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:17.659185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2e684-c872-4b6d-8750-c2006741c536 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:17.674240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edfa94-a8ef-4a7f-9c87-bbe91e1b326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:17.674870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 105/207] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:17 2022] GET /identity/v3/role_assignments?user.id=d5abf3d41214424293a5fffeb12e74fd&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 259 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:17.680644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edfa94-a8ef-4a7f-9c87-bbe91e1b326b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:17.680644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edfa94-a8ef-4a7f-9c87-bbe91e1b326b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:17.680644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edfa94-a8ef-4a7f-9c87-bbe91e1b326b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:17.680644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edfa94-a8ef-4a7f-9c87-bbe91e1b326b None admin] RBAC: Adding query filter params (role.id=c31070d0b9f143a49945c541a812a52e, scope.project.id=fc7e31d30c684107b874c500626aa093, user.id=b4ceaa3593324e618949bc826b95c8a7) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:17.680644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edfa94-a8ef-4a7f-9c87-bbe91e1b326b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:17.680644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edfa94-a8ef-4a7f-9c87-bbe91e1b326b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:17.686336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 103/208] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:17 2022] GET /identity/v3/role_assignments?user.id=b4ceaa3593324e618949bc826b95c8a7&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=c31070d0b9f143a49945c541a812a52e => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:18.139014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886038-2bb2-4fa4-8f03-38dd78eb56c7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.139609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886038-2bb2-4fa4-8f03-38dd78eb56c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.140026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886038-2bb2-4fa4-8f03-38dd78eb56c7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.141786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 106/209] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:18.148869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5fe2-2522-4191-b1e1-64832bfea613 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.150084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5fe2-2522-4191-b1e1-64832bfea613 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.150610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5fe2-2522-4191-b1e1-64832bfea613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.172456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-04fe5fe2-2522-4191-b1e1-64832bfea613 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:18.173997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-04fe5fe2-2522-4191-b1e1-64832bfea613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:18.194805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660520e-17bc-44bf-b8ea-da3cbcae214a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.196038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660520e-17bc-44bf-b8ea-da3cbcae214a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.196546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660520e-17bc-44bf-b8ea-da3cbcae214a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.198511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 107/210] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:18.205113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379aa5b-47a6-402a-b343-e53f905e4ec3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.205512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379aa5b-47a6-402a-b343-e53f905e4ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.205684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379aa5b-47a6-402a-b343-e53f905e4ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.235728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2379aa5b-47a6-402a-b343-e53f905e4ec3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:18.236948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2379aa5b-47a6-402a-b343-e53f905e4ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:18.279632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 104/211] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:18.290841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:18.305820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe5fe2-2522-4191-b1e1-64832bfea613 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:18.343926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 108/212] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:18.369509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379aa5b-47a6-402a-b343-e53f905e4ec3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:18.431760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe5fe2-2522-4191-b1e1-64832bfea613 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:18.483472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379aa5b-47a6-402a-b343-e53f905e4ec3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:18.484588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065053-0de7-4de9-9515-6717d2f44c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:18.485449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:18.486770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065053-0de7-4de9-9515-6717d2f44c70 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.487299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065053-0de7-4de9-9515-6717d2f44c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.489031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065053-0de7-4de9-9515-6717d2f44c70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.505656 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d065053-0de7-4de9-9515-6717d2f44c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6d065053-0de7-4de9-9515-6717d2f44c70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:18.513226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:18.514440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:18.515403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:18.518043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 105/213] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:18.525683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065053-0de7-4de9-9515-6717d2f44c70 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:18.528355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908743af-dee5-4c05-9d85-f1098fdbcec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:18.528355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908743af-dee5-4c05-9d85-f1098fdbcec4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.529501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908743af-dee5-4c05-9d85-f1098fdbcec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.529501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908743af-dee5-4c05-9d85-f1098fdbcec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.531093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908743af-dee5-4c05-9d85-f1098fdbcec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:18.532172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908743af-dee5-4c05-9d85-f1098fdbcec4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:18.534350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 109/214] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:18.544849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908743af-dee5-4c05-9d85-f1098fdbcec4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:18.591671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:18.672134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065053-0de7-4de9-9515-6717d2f44c70 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:18.691682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908743af-dee5-4c05-9d85-f1098fdbcec4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:18.716630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:18.717345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.717687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.718067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.719125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:18.719547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:18.721253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:18.734739 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 106/215] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:18.735754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37d76f-c86f-4b7f-ac02-24cd4132a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:18.736323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37d76f-c86f-4b7f-ac02-24cd4132a19d None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.736604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37d76f-c86f-4b7f-ac02-24cd4132a19d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.736877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37d76f-c86f-4b7f-ac02-24cd4132a19d None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.737564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37d76f-c86f-4b7f-ac02-24cd4132a19d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:18.739617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37d76f-c86f-4b7f-ac02-24cd4132a19d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:18.744671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:18.768897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 110/216] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:18 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:18.805437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:18.902177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994041a-4c5e-4838-a34a-5b6a05c5e245 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:18.960502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9b7b-0ae4-44a3-9c53-3e7b261aed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:18.962000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9b7b-0ae4-44a3-9c53-3e7b261aed76 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:18.962493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9b7b-0ae4-44a3-9c53-3e7b261aed76 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:18.962987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9b7b-0ae4-44a3-9c53-3e7b261aed76 None admin] PATH_INFO: `/v3/users/030227600d9e4adaaf9fef686ea82b8b` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:18.985889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9b7b-0ae4-44a3-9c53-3e7b261aed76 None admin] RBAC: Authorizing `identity:get_user(user_id=030227600d9e4adaaf9fef686ea82b8b)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:18.987774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9b7b-0ae4-44a3-9c53-3e7b261aed76 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:18.990202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 107/217] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:18 2022] GET /identity/v3/users/030227600d9e4adaaf9fef686ea82b8b => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:18.997934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37d76f-c86f-4b7f-ac02-24cd4132a19d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:19.133894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:19.148016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37d76f-c86f-4b7f-ac02-24cd4132a19d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:19.196980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45734189-2a95-4f7a-a5cc-c683f0240490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:19.197613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734189-2a95-4f7a-a5cc-c683f0240490 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:19.197927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734189-2a95-4f7a-a5cc-c683f0240490 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:19.198192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734189-2a95-4f7a-a5cc-c683f0240490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:19.299873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45734189-2a95-4f7a-a5cc-c683f0240490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:19.301461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45734189-2a95-4f7a-a5cc-c683f0240490 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:19.435244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:19.454369 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 111/218] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:19.459843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9b7b-0ae4-44a3-9c53-3e7b261aed76 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:19.643807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:19.650063 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9b7b-0ae4-44a3-9c53-3e7b261aed76 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:19.700109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cca4f-9b6d-46fc-aa28-583851b741c7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:19.700855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cca4f-9b6d-46fc-aa28-583851b741c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:19.700855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cca4f-9b6d-46fc-aa28-583851b741c7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:19.702053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 112/219] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:19.705278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d03f0-24ef-44c1-a172-923302bee4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:19.706008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d03f0-24ef-44c1-a172-923302bee4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:19.706288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d03f0-24ef-44c1-a172-923302bee4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:19.706567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d03f0-24ef-44c1-a172-923302bee4e1 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:19.707846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d03f0-24ef-44c1-a172-923302bee4e1 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:19.710547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ebece-3662-4503-ae17-4bd1103eee99 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:19.710836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ebece-3662-4503-ae17-4bd1103eee99 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:19.711120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ebece-3662-4503-ae17-4bd1103eee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:19.716094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d03f0-24ef-44c1-a172-923302bee4e1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:19.724411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 108/220] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:19 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:19.727467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d03f0-24ef-44c1-a172-923302bee4e1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:19.755229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a29ebece-3662-4503-ae17-4bd1103eee99 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:19.756502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a29ebece-3662-4503-ae17-4bd1103eee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:19.937860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 113/221] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:19.939891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a4876-3106-4b36-8760-d48478852711 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:19.940248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a4876-3106-4b36-8760-d48478852711 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:19.940541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a4876-3106-4b36-8760-d48478852711 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:19.942019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 114/222] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:19.949593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0026c2-d0a1-4f38-8716-47dc682ccaf3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:19.949910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0026c2-d0a1-4f38-8716-47dc682ccaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:19.950170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0026c2-d0a1-4f38-8716-47dc682ccaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:19.975636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d03f0-24ef-44c1-a172-923302bee4e1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:19.984299 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8a0026c2-d0a1-4f38-8716-47dc682ccaf3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:19.985766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8a0026c2-d0a1-4f38-8716-47dc682ccaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:20.052229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:20.053104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:20.053597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:20.054935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:20.055932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] RBAC: Adding query filter params (role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5, user.id=030227600d9e4adaaf9fef686ea82b8b) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:20.056388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:20.058017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:20.064895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 109/223] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:19 2022] GET /identity/v3/role_assignments?user.id=030227600d9e4adaaf9fef686ea82b8b&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=cb911cef057e44fb9c8004a419568df8 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:20.066117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:20.091075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 115/224] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:20.102647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:20.127328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0026c2-d0a1-4f38-8716-47dc682ccaf3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:20.197235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e5270-1c64-47ee-8119-99bdccef5719 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:20.239545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:20.266314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0562c-bc9f-486d-81fa-509708206286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:20.267906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0562c-bc9f-486d-81fa-509708206286 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:20.269047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0562c-bc9f-486d-81fa-509708206286 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:20.269653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0562c-bc9f-486d-81fa-509708206286 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:20.296698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0562c-bc9f-486d-81fa-509708206286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-bdb0562c-bc9f-486d-81fa-509708206286 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:20.307170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:20.308281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:20.309173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:20.312527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 110/225] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:23:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:20.321122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0562c-bc9f-486d-81fa-509708206286 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:20.370709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0026c2-d0a1-4f38-8716-47dc682ccaf3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:20.419285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f043-13f0-49ab-929f-52a6ad9fd46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:20.420362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f043-13f0-49ab-929f-52a6ad9fd46e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:20.420842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f043-13f0-49ab-929f-52a6ad9fd46e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:20.421349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f043-13f0-49ab-929f-52a6ad9fd46e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:20.436841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40f043-13f0-49ab-929f-52a6ad9fd46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1e40f043-13f0-49ab-929f-52a6ad9fd46e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:20.443133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:20.444040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:20.445348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:20.448431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 116/226] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:20.451848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:20.456662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f043-13f0-49ab-929f-52a6ad9fd46e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:20.473767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0562c-bc9f-486d-81fa-509708206286 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:20.548177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:20.549186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:20.549667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:20.550137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:20.551090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:20.551641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:20.553310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:20.573416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 111/227] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:20.590842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f043-13f0-49ab-929f-52a6ad9fd46e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:20.593102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:20.611809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:20.640216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:20.641308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:20.641742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:20.642167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:20.643256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:20.643763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:20.645927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:20.656969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 117/228] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:20.663177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:20.797457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3992107-2775-4f36-8775-d2cff44f3553 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:20.838056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8e717-03c8-4a67-872c-364beaf6a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:20.838961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e717-03c8-4a67-872c-364beaf6a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:20.839449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e717-03c8-4a67-872c-364beaf6a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:20.839874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e717-03c8-4a67-872c-364beaf6a5b5 None admin] PATH_INFO: `/v3/users/d5abf3d41214424293a5fffeb12e74fd` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:20.841738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8e717-03c8-4a67-872c-364beaf6a5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d5abf3d41214424293a5fffeb12e74fd)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:20.843343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8e717-03c8-4a67-872c-364beaf6a5b5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:20.845458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 118/229] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:20 2022] GET /identity/v3/users/d5abf3d41214424293a5fffeb12e74fd => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:20.856520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8e717-03c8-4a67-872c-364beaf6a5b5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:20.871666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb1f5f-5bfa-4098-b519-e12768bb1081 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:20.950501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bc813-dfce-49f4-a13e-3d1ede7022ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:20.953798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bc813-dfce-49f4-a13e-3d1ede7022ce None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:20.953798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bc813-dfce-49f4-a13e-3d1ede7022ce None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:20.953798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bc813-dfce-49f4-a13e-3d1ede7022ce None admin] PATH_INFO: `/v3/users/d5abf3d41214424293a5fffeb12e74fd` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:20.953798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bc813-dfce-49f4-a13e-3d1ede7022ce None admin] RBAC: Authorizing `identity:get_user(user_id=d5abf3d41214424293a5fffeb12e74fd)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:20.954621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bc813-dfce-49f4-a13e-3d1ede7022ce None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:20.957696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 112/230] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:20 2022] GET /identity/v3/users/d5abf3d41214424293a5fffeb12e74fd => generated 283 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:20.957897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:20.963738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bc813-dfce-49f4-a13e-3d1ede7022ce None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:21.011416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:21.083562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8e717-03c8-4a67-872c-364beaf6a5b5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:21.119815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bc813-dfce-49f4-a13e-3d1ede7022ce None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:21.160342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14419af5-5c3d-42c6-938d-c9e71939c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:21.161147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14419af5-5c3d-42c6-938d-c9e71939c94e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:21.161504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14419af5-5c3d-42c6-938d-c9e71939c94e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:21.161858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14419af5-5c3d-42c6-938d-c9e71939c94e None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:21.166832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a47aa-675f-4f87-91d3-04824e45a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:21.167747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a47aa-675f-4f87-91d3-04824e45a709 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:21.167901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14419af5-5c3d-42c6-938d-c9e71939c94e None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:21.168352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a47aa-675f-4f87-91d3-04824e45a709 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:21.168825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a47aa-675f-4f87-91d3-04824e45a709 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:21.169629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14419af5-5c3d-42c6-938d-c9e71939c94e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:21.170365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a47aa-675f-4f87-91d3-04824e45a709 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:21.171549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 119/231] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:20 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:21.172313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a47aa-675f-4f87-91d3-04824e45a709 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:21.174438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 113/232] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:20 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:21.177640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14419af5-5c3d-42c6-938d-c9e71939c94e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:21.180676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a47aa-675f-4f87-91d3-04824e45a709 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:21.336724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14419af5-5c3d-42c6-938d-c9e71939c94e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:21.349993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:21.380189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d6dbe-f126-44b9-b06e-eb6cd605ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:21.381696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d6dbe-f126-44b9-b06e-eb6cd605ca91 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:21.383311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d6dbe-f126-44b9-b06e-eb6cd605ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:21.383880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d6dbe-f126-44b9-b06e-eb6cd605ca91 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/users/d5abf3d41214424293a5fffeb12e74fd/roles/a3cb41ec3a524b60bc728cd4b0ab78e0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:21.387592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d6dbe-f126-44b9-b06e-eb6cd605ca91 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5, user_id=d5abf3d41214424293a5fffeb12e74fd, role_id=a3cb41ec3a524b60bc728cd4b0ab78e0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:21.389956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d6dbe-f126-44b9-b06e-eb6cd605ca91 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:21.394923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:21.410022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 120/233] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:21 2022] PUT /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/users/d5abf3d41214424293a5fffeb12e74fd/roles/a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:23:21.428004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a47aa-675f-4f87-91d3-04824e45a709 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:21.467766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4442a-7a7e-45f2-9bff-2260dacab61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:21.468536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4442a-7a7e-45f2-9bff-2260dacab61c None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:21.468893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4442a-7a7e-45f2-9bff-2260dacab61c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:21.469167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4442a-7a7e-45f2-9bff-2260dacab61c None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/users/d5abf3d41214424293a5fffeb12e74fd/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:21.471365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4442a-7a7e-45f2-9bff-2260dacab61c None admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5, user_id=d5abf3d41214424293a5fffeb12e74fd, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:21.473117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4442a-7a7e-45f2-9bff-2260dacab61c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:21.489862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 114/234] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:21 2022] PUT /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/users/d5abf3d41214424293a5fffeb12e74fd/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:21.624323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc018550-b094-4c7b-bd03-fa7d60e63a9a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:21.624940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc018550-b094-4c7b-bd03-fa7d60e63a9a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:21.625422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc018550-b094-4c7b-bd03-fa7d60e63a9a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:21.627782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 121/235] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:21.636400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50532ec6-bb65-4af7-b4c3-2eb4978dad4f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:21.637370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50532ec6-bb65-4af7-b4c3-2eb4978dad4f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:21.638018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50532ec6-bb65-4af7-b4c3-2eb4978dad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:21.667469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-50532ec6-bb65-4af7-b4c3-2eb4978dad4f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:21.669088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-50532ec6-bb65-4af7-b4c3-2eb4978dad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:21.767181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 115/236] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:21.772735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7489-1b60-4b00-92c8-c41fc20413e7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:21.773270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7489-1b60-4b00-92c8-c41fc20413e7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:21.773741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7489-1b60-4b00-92c8-c41fc20413e7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:21.775616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 122/237] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:21.781028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321f18b-b3c4-4c01-868e-dac2eaa97f7d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:21.781315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321f18b-b3c4-4c01-868e-dac2eaa97f7d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:21.781596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321f18b-b3c4-4c01-868e-dac2eaa97f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:21.803273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a321f18b-b3c4-4c01-868e-dac2eaa97f7d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:21.805037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a321f18b-b3c4-4c01-868e-dac2eaa97f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:21.808201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af7489-1b60-4b00-92c8-c41fc20413e7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:21.888369 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 116/238] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:21.917087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321f18b-b3c4-4c01-868e-dac2eaa97f7d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:21.925864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:22.005775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af7489-1b60-4b00-92c8-c41fc20413e7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:22.031431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321f18b-b3c4-4c01-868e-dac2eaa97f7d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:22.073563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734474e-9b8c-45ce-8480-888471dab29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:22.074238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734474e-9b8c-45ce-8480-888471dab29e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:22.074519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734474e-9b8c-45ce-8480-888471dab29e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:22.074801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734474e-9b8c-45ce-8480-888471dab29e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:22.076600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734474e-9b8c-45ce-8480-888471dab29e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:22.078096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734474e-9b8c-45ce-8480-888471dab29e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:22.079791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 117/239] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:22.080538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6cde2-941f-4ceb-a607-a0ec96d6d01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:22.081198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6cde2-941f-4ceb-a607-a0ec96d6d01e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:22.081483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6cde2-941f-4ceb-a607-a0ec96d6d01e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:22.081755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6cde2-941f-4ceb-a607-a0ec96d6d01e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:22.087973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734474e-9b8c-45ce-8480-888471dab29e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:22.107359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6cde2-941f-4ceb-a607-a0ec96d6d01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-62a6cde2-941f-4ceb-a607-a0ec96d6d01e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:22.121298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:22.122635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:22.124823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 123/240] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:22.129825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6cde2-941f-4ceb-a607-a0ec96d6d01e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:22.190208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:22.206973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:22.213472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734474e-9b8c-45ce-8480-888471dab29e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:22.253876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671f66-d7d0-4e0c-8d64-6c3813fa37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:22.254522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671f66-d7d0-4e0c-8d64-6c3813fa37c1 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:22.254806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671f66-d7d0-4e0c-8d64-6c3813fa37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:22.255085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671f66-d7d0-4e0c-8d64-6c3813fa37c1 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:22.255836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8671f66-d7d0-4e0c-8d64-6c3813fa37c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:22.257346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8671f66-d7d0-4e0c-8d64-6c3813fa37c1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:22.280559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 118/241] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:22 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:22.361241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6cde2-941f-4ceb-a607-a0ec96d6d01e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:22.402494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:22.403938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:22.404703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:22.405213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:22.406176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:22.406695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:22.408340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:22.419244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 124/242] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:22.427188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671f66-d7d0-4e0c-8d64-6c3813fa37c1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:22.559059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671f66-d7d0-4e0c-8d64-6c3813fa37c1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:22.592219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:22.600491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732a109-13b5-4f02-9907-63e0052899fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:22.601304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a109-13b5-4f02-9907-63e0052899fa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:22.601699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a109-13b5-4f02-9907-63e0052899fa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:22.602008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a109-13b5-4f02-9907-63e0052899fa None admin] PATH_INFO: `/v3/users/eb22ff911c3949cba76b0b40454a6c40` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:22.619779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732a109-13b5-4f02-9907-63e0052899fa None admin] RBAC: Authorizing `identity:get_user(user_id=eb22ff911c3949cba76b0b40454a6c40)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:22.621299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732a109-13b5-4f02-9907-63e0052899fa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:22.623100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 119/243] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:22 2022] GET /identity/v3/users/eb22ff911c3949cba76b0b40454a6c40 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:22.633095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:22.762425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:22.792514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba75a9f-12bd-44b4-9f97-5abc260732bd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:22.839843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8200c1-f12c-45ca-a84c-3a3d6abf51f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:22.840731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8200c1-f12c-45ca-a84c-3a3d6abf51f7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:22.840731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8200c1-f12c-45ca-a84c-3a3d6abf51f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:22.841180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8200c1-f12c-45ca-a84c-3a3d6abf51f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:22.964811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8200c1-f12c-45ca-a84c-3a3d6abf51f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:22.967911 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8200c1-f12c-45ca-a84c-3a3d6abf51f7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:22.974919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82fd1-ce40-42ce-8528-a64e1c6fd4cb None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:22.975205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82fd1-ce40-42ce-8528-a64e1c6fd4cb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:22.975614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82fd1-ce40-42ce-8528-a64e1c6fd4cb None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:22.977614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 120/244] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:22.989781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f453fa-bcdb-4efa-a166-0c004332f00b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:22.990348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f453fa-bcdb-4efa-a166-0c004332f00b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:22.990640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f453fa-bcdb-4efa-a166-0c004332f00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:23.016147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-16f453fa-bcdb-4efa-a166-0c004332f00b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:23.017455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-16f453fa-bcdb-4efa-a166-0c004332f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:23.088933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:23.100721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 125/245] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:23.107024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8200c1-f12c-45ca-a84c-3a3d6abf51f7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:23.118081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 121/246] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:23.168045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f453fa-bcdb-4efa-a166-0c004332f00b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:23.229873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8200c1-f12c-45ca-a84c-3a3d6abf51f7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:23.268776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785cb8-d3ad-4c8d-b163-19c1e3745312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:23.269675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785cb8-d3ad-4c8d-b163-19c1e3745312 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:23.270079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785cb8-d3ad-4c8d-b163-19c1e3745312 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:23.270474 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785cb8-d3ad-4c8d-b163-19c1e3745312 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:23.271910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d785cb8-d3ad-4c8d-b163-19c1e3745312 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:23.274129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d785cb8-d3ad-4c8d-b163-19c1e3745312 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:23.276365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 126/247] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:23 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:23.300651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785cb8-d3ad-4c8d-b163-19c1e3745312 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:23.335888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f453fa-bcdb-4efa-a166-0c004332f00b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:23.358558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:23.391365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e39332-427e-451f-8abf-ddfac89adc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:23.392450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e39332-427e-451f-8abf-ddfac89adc2b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:23.393031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e39332-427e-451f-8abf-ddfac89adc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:23.393504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e39332-427e-451f-8abf-ddfac89adc2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:23.428542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e39332-427e-451f-8abf-ddfac89adc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-13e39332-427e-451f-8abf-ddfac89adc2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:23.442002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:23.443091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:23.443902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 122/248] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:23.447697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:23.453150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e39332-427e-451f-8abf-ddfac89adc2b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:23.591399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785cb8-d3ad-4c8d-b163-19c1e3745312 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:23.645634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e39332-427e-451f-8abf-ddfac89adc2b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:23.668942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:23.669587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:23.669874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:23.670149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:23.670953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] RBAC: Adding query filter params (role.id=c31070d0b9f143a49945c541a812a52e, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5, user.id=eb22ff911c3949cba76b0b40454a6c40) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:23.671266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:23.672750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:23.686486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 127/249] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:23 2022] GET /identity/v3/role_assignments?user.id=eb22ff911c3949cba76b0b40454a6c40&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=c31070d0b9f143a49945c541a812a52e => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:23.722904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:23.723592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:23.723877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:23.724154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:23.724892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:23.725319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:23.726820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:23.740890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 123/250] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:23.747516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:23.871408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412c26-5ca9-476c-be67-d417b39f3dce None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:23.896777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:23.908609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47d86c-4daa-4ac5-8e72-69c811fb01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:23.909276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47d86c-4daa-4ac5-8e72-69c811fb01dd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:23.909561 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47d86c-4daa-4ac5-8e72-69c811fb01dd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:23.909839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47d86c-4daa-4ac5-8e72-69c811fb01dd None admin] PATH_INFO: `/v3/users/030227600d9e4adaaf9fef686ea82b8b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:23.911070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47d86c-4daa-4ac5-8e72-69c811fb01dd None admin] RBAC: Authorizing `identity:get_user(user_id=030227600d9e4adaaf9fef686ea82b8b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:23.912586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47d86c-4daa-4ac5-8e72-69c811fb01dd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:23.915466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 128/251] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:23 2022] GET /identity/v3/users/030227600d9e4adaaf9fef686ea82b8b => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:23.921943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:24.005654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:24.084070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21377e-2784-42cb-a196-05cd19a2abff None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:24.137224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5c1a6-770c-46c4-afb1-0e3db467ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:24.137881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c1a6-770c-46c4-afb1-0e3db467ed0e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:24.138159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c1a6-770c-46c4-afb1-0e3db467ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:24.138425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c1a6-770c-46c4-afb1-0e3db467ed0e None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:24.139613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5c1a6-770c-46c4-afb1-0e3db467ed0e None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:24.141128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5c1a6-770c-46c4-afb1-0e3db467ed0e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:24.143113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 124/252] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:23 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:24.150754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47d86c-4daa-4ac5-8e72-69c811fb01dd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:24.200923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aa5af-1c35-4123-8466-d36d70142971 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:24.201236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aa5af-1c35-4123-8466-d36d70142971 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:24.201488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aa5af-1c35-4123-8466-d36d70142971 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:24.202827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 125/253] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:24.230451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd39d-efc9-4942-88df-9fa5b609cd2b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:24.230747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd39d-efc9-4942-88df-9fa5b609cd2b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:24.231010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd39d-efc9-4942-88df-9fa5b609cd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:24.261065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e39fd39d-efc9-4942-88df-9fa5b609cd2b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:24.262266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e39fd39d-efc9-4942-88df-9fa5b609cd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:24.385481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47d86c-4daa-4ac5-8e72-69c811fb01dd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:24.415177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 126/254] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:24.457046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fd39d-efc9-4942-88df-9fa5b609cd2b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:24.471487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917004c-919c-48eb-a270-4b22af6a263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:24.472495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917004c-919c-48eb-a270-4b22af6a263c None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:24.472983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917004c-919c-48eb-a270-4b22af6a263c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:24.473511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917004c-919c-48eb-a270-4b22af6a263c None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/users/030227600d9e4adaaf9fef686ea82b8b/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:24.476867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917004c-919c-48eb-a270-4b22af6a263c None admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5, user_id=030227600d9e4adaaf9fef686ea82b8b, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:24.478357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917004c-919c-48eb-a270-4b22af6a263c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:24.504608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 129/255] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:24 2022] PUT /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/users/030227600d9e4adaaf9fef686ea82b8b/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:24.547962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:24.640889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fd39d-efc9-4942-88df-9fa5b609cd2b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:24.696326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39265a-acb8-4945-95b5-ab8d56a82f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:24.697072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39265a-acb8-4945-95b5-ab8d56a82f5b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:24.697362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39265a-acb8-4945-95b5-ab8d56a82f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:24.697642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39265a-acb8-4945-95b5-ab8d56a82f5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:24.713151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39265a-acb8-4945-95b5-ab8d56a82f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-de39265a-acb8-4945-95b5-ab8d56a82f5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:24.718433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:24.719498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:24.720274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:24.720853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 127/256] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:24.726344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917004c-919c-48eb-a270-4b22af6a263c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:24.797706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:24.870145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917004c-919c-48eb-a270-4b22af6a263c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:24.918313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:24.918963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:24.919216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:24.919520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:24.920296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:24.920549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:24.921940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:24.932499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 130/257] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:24.938738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39265a-acb8-4945-95b5-ab8d56a82f5b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:25.077643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:25.084683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39265a-acb8-4945-95b5-ab8d56a82f5b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:25.134098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d4119-29ec-456e-9212-d58947a9588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:25.134983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d4119-29ec-456e-9212-d58947a9588e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:25.135453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d4119-29ec-456e-9212-d58947a9588e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:25.135868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d4119-29ec-456e-9212-d58947a9588e None admin] PATH_INFO: `/v3/users/d5abf3d41214424293a5fffeb12e74fd` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:25.137184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d4119-29ec-456e-9212-d58947a9588e None admin] RBAC: Authorizing `identity:get_user(user_id=d5abf3d41214424293a5fffeb12e74fd)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:25.138801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d4119-29ec-456e-9212-d58947a9588e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:25.141029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 128/258] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:24 2022] GET /identity/v3/users/d5abf3d41214424293a5fffeb12e74fd => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:25.148578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:25.169716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be372-4edc-4e04-a7ce-963e4078c0ff None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:25.170228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be372-4edc-4e04-a7ce-963e4078c0ff None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:25.170668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be372-4edc-4e04-a7ce-963e4078c0ff None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:25.172305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 129/259] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:25.178411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852a74-1e83-403e-a6cf-9ebb31a53acd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:25.179156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852a74-1e83-403e-a6cf-9ebb31a53acd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:25.180463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852a74-1e83-403e-a6cf-9ebb31a53acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:25.220547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-00852a74-1e83-403e-a6cf-9ebb31a53acd None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:25.221616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-00852a74-1e83-403e-a6cf-9ebb31a53acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:25.292528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80634b03-1247-468f-a06b-7a48da947587 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:25.323769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:25.329143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02016a64-64af-451b-8566-3b468da98d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:25.329987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02016a64-64af-451b-8566-3b468da98d7e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:25.330445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02016a64-64af-451b-8566-3b468da98d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:25.330858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02016a64-64af-451b-8566-3b468da98d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:25.360724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 130/260] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:25.400546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852a74-1e83-403e-a6cf-9ebb31a53acd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:25.428366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02016a64-64af-451b-8566-3b468da98d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:25.430124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02016a64-64af-451b-8566-3b468da98d7e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:25.587724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:25.602339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852a74-1e83-403e-a6cf-9ebb31a53acd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:25.660423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989d25a-f1e0-4636-a2ee-16532d3cc251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:25.661452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d25a-f1e0-4636-a2ee-16532d3cc251 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:25.661925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d25a-f1e0-4636-a2ee-16532d3cc251 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:25.662399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d25a-f1e0-4636-a2ee-16532d3cc251 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:25.686335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989d25a-f1e0-4636-a2ee-16532d3cc251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3989d25a-f1e0-4636-a2ee-16532d3cc251 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:25.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:25.692678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:25.693428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:25.696402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 131/261] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:25.702120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 131/262] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:25.702494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989d25a-f1e0-4636-a2ee-16532d3cc251 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:25.707486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02016a64-64af-451b-8566-3b468da98d7e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:25.751753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:25.856951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989d25a-f1e0-4636-a2ee-16532d3cc251 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:25.927399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:25.927399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:25.927399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:25.927399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:25.927795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:25.927795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:25.927795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:25.942230 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 132/263] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:25.947860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:25.985490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:26.002239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02016a64-64af-451b-8566-3b468da98d7e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:26.064000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7c754-625d-4b4b-94f5-ce45c96fd623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:26.064655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c754-625d-4b4b-94f5-ce45c96fd623 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.064988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c754-625d-4b4b-94f5-ce45c96fd623 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.065269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c754-625d-4b4b-94f5-ce45c96fd623 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.067250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7c754-625d-4b4b-94f5-ce45c96fd623 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:26.068732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7c754-625d-4b4b-94f5-ce45c96fd623 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:26.071752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 132/264] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:25 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:26.078179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcdb37-798d-4a61-8ecf-d01dc7fcba1a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.078460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcdb37-798d-4a61-8ecf-d01dc7fcba1a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.078733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcdb37-798d-4a61-8ecf-d01dc7fcba1a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.080124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 133/265] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:26.083093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcdb37-798d-4a61-8ecf-d01dc7fcba1a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:26.130422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa3f13-41b2-4c72-8a8a-d0872fe97637 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:26.169349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452de8ac-c2bd-4d78-9d33-3c98b2999355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:26.170061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452de8ac-c2bd-4d78-9d33-3c98b2999355 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.170450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452de8ac-c2bd-4d78-9d33-3c98b2999355 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.170732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452de8ac-c2bd-4d78-9d33-3c98b2999355 None admin] PATH_INFO: `/v3/users/d5abf3d41214424293a5fffeb12e74fd` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.172042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452de8ac-c2bd-4d78-9d33-3c98b2999355 None admin] RBAC: Authorizing `identity:get_user(user_id=d5abf3d41214424293a5fffeb12e74fd)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:26.173640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452de8ac-c2bd-4d78-9d33-3c98b2999355 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:26.179666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 133/266] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:25 2022] GET /identity/v3/users/d5abf3d41214424293a5fffeb12e74fd => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:26.179666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7844f70-cbcf-4913-b607-e4bef63ecb3c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.179666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7844f70-cbcf-4913-b607-e4bef63ecb3c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.179666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7844f70-cbcf-4913-b607-e4bef63ecb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.198299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c7844f70-cbcf-4913-b607-e4bef63ecb3c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:26.199646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c7844f70-cbcf-4913-b607-e4bef63ecb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:26.202749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:26.228368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcdb37-798d-4a61-8ecf-d01dc7fcba1a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:26.275897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbedf75-92ae-459d-aa18-21981f4b9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:26.276505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedf75-92ae-459d-aa18-21981f4b9ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.276794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedf75-92ae-459d-aa18-21981f4b9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.277073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedf75-92ae-459d-aa18-21981f4b9ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.277862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbedf75-92ae-459d-aa18-21981f4b9ed6 None admin] RBAC: Adding query filter params (role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5, user.id=d5abf3d41214424293a5fffeb12e74fd) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:26.278176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbedf75-92ae-459d-aa18-21981f4b9ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:26.279860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbedf75-92ae-459d-aa18-21981f4b9ed6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:26.291397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 134/267] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:26 2022] GET /identity/v3/role_assignments?user.id=d5abf3d41214424293a5fffeb12e74fd&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:26.291397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe60d-0e0a-4aba-bf98-6d56b977d3a2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.291397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe60d-0e0a-4aba-bf98-6d56b977d3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.291397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe60d-0e0a-4aba-bf98-6d56b977d3a2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.291397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 135/268] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:26.291804 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe60d-0e0a-4aba-bf98-6d56b977d3a2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:26.294226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 134/269] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:26.310167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549c46a-df23-4d28-add5-6b8b282a83b0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.310835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549c46a-df23-4d28-add5-6b8b282a83b0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.311345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549c46a-df23-4d28-add5-6b8b282a83b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.343409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2549c46a-df23-4d28-add5-6b8b282a83b0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:26.343409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2549c46a-df23-4d28-add5-6b8b282a83b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:26.359984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:26.445881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe60d-0e0a-4aba-bf98-6d56b977d3a2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:26.479515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 135/270] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:26.480541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549c46a-df23-4d28-add5-6b8b282a83b0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:26.541082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f0540-5395-49c6-9d03-649b21ba0f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:26.542564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0540-5395-49c6-9d03-649b21ba0f18 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.543142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0540-5395-49c6-9d03-649b21ba0f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.543956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0540-5395-49c6-9d03-649b21ba0f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.570788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:26.637448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549c46a-df23-4d28-add5-6b8b282a83b0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:26.649077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f0540-5395-49c6-9d03-649b21ba0f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:26.650833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f0540-5395-49c6-9d03-649b21ba0f18 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:26.681786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c7da-d655-4007-a366-597bcf8179be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:26.682777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c7da-d655-4007-a366-597bcf8179be None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.683333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c7da-d655-4007-a366-597bcf8179be None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.683777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c7da-d655-4007-a366-597bcf8179be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.685208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253c7da-d655-4007-a366-597bcf8179be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:26.686947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253c7da-d655-4007-a366-597bcf8179be None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:26.688942 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 136/271] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:26.689854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c7da-d655-4007-a366-597bcf8179be None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:26.709651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:26.774857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 136/272] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:26.780614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f0540-5395-49c6-9d03-649b21ba0f18 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:26.821306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c7da-d655-4007-a366-597bcf8179be None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:26.846396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:26.858976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d6bd-499b-45fb-86dc-038f3b8dc008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:26.859874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d6bd-499b-45fb-86dc-038f3b8dc008 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.860298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d6bd-499b-45fb-86dc-038f3b8dc008 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.860738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d6bd-499b-45fb-86dc-038f3b8dc008 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.871668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d6bd-499b-45fb-86dc-038f3b8dc008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5787d6bd-499b-45fb-86dc-038f3b8dc008 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:26.876936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:26.877977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:26.878940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:26.885889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 137/273] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:26.887415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0112-b89d-43c8-be16-2427db734717 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.887870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0112-b89d-43c8-be16-2427db734717 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.888293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0112-b89d-43c8-be16-2427db734717 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.889761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 138/274] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:26.890596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa0112-b89d-43c8-be16-2427db734717 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:26.907191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f0540-5395-49c6-9d03-649b21ba0f18 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:26.947494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa69bb6-9556-4801-be4c-20ab1ec9049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:26.948264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa69bb6-9556-4801-be4c-20ab1ec9049e None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:26.948644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa69bb6-9556-4801-be4c-20ab1ec9049e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:26.949020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa69bb6-9556-4801-be4c-20ab1ec9049e None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:26.949906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa69bb6-9556-4801-be4c-20ab1ec9049e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:26.951520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa69bb6-9556-4801-be4c-20ab1ec9049e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:26.976822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 137/275] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:26 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:26.977892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:26.978778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa69bb6-9556-4801-be4c-20ab1ec9049e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:27.011611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa0112-b89d-43c8-be16-2427db734717 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:27.060874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc03dd-a106-4034-82a0-e072eefe1dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:27.061857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc03dd-a106-4034-82a0-e072eefe1dbd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.062424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc03dd-a106-4034-82a0-e072eefe1dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.062876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc03dd-a106-4034-82a0-e072eefe1dbd None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.064506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc03dd-a106-4034-82a0-e072eefe1dbd None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:27.066584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc03dd-a106-4034-82a0-e072eefe1dbd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:27.068780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 139/276] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:26 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:27.075872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f762-cc09-48ce-a615-4b351b46714b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.076457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f762-cc09-48ce-a615-4b351b46714b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.077008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f762-cc09-48ce-a615-4b351b46714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.098454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4964f762-cc09-48ce-a615-4b351b46714b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:27.098930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa69bb6-9556-4801-be4c-20ab1ec9049e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:27.100705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.102027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4964f762-cc09-48ce-a615-4b351b46714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:27.160757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:27.161399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.161720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.161975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.162666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:27.162970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:27.166287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:27.175082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 138/277] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:27.176087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:27.222502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 140/278] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:27.223787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964f762-cc09-48ce-a615-4b351b46714b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:27.318046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe4291-0799-4e0d-b6af-bc4a9bfa97c5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:27.345147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.364572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:27.365205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.365610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.365883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.367299 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5, user.id=d5abf3d41214424293a5fffeb12e74fd) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:27.367729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:27.369196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:27.376097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964f762-cc09-48ce-a615-4b351b46714b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:27.377154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 139/279] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:27 2022] GET /identity/v3/role_assignments?user.id=d5abf3d41214424293a5fffeb12e74fd&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=7a7079c0864e4bb7acaa71238097426e => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:27.378005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:27.427433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.440980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889e4e4-cee3-4cb4-8c50-b23d9f9666c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:27.442021 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889e4e4-cee3-4cb4-8c50-b23d9f9666c9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.442512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889e4e4-cee3-4cb4-8c50-b23d9f9666c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.443001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889e4e4-cee3-4cb4-8c50-b23d9f9666c9 None admin] PATH_INFO: `/v3/users/7db43e280dae4a1fb6b975fd43b41fd1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.475206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889e4e4-cee3-4cb4-8c50-b23d9f9666c9 None admin] RBAC: Authorizing `identity:get_user(user_id=7db43e280dae4a1fb6b975fd43b41fd1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:27.478965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889e4e4-cee3-4cb4-8c50-b23d9f9666c9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:27.482908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 141/280] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:27 2022] GET /identity/v3/users/7db43e280dae4a1fb6b975fd43b41fd1 => generated 293 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:27.487936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889e4e4-cee3-4cb4-8c50-b23d9f9666c9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:27.586956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151516fe-1be5-4324-b29b-c2e143788dbd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:27.643601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e6f1c-f34d-41da-a8b1-60818e93e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:27.644763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6f1c-f34d-41da-a8b1-60818e93e48a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.645053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6f1c-f34d-41da-a8b1-60818e93e48a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.645331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6f1c-f34d-41da-a8b1-60818e93e48a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.663354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e6f1c-f34d-41da-a8b1-60818e93e48a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d09e6f1c-f34d-41da-a8b1-60818e93e48a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:27.676506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:27.677782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:27.678549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 140/281] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:27.689006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e6f1c-f34d-41da-a8b1-60818e93e48a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:27.692145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889e4e4-cee3-4cb4-8c50-b23d9f9666c9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:27.730975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.739018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0270a6-0d48-490e-9a8f-6d42c65510bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:27.739715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0270a6-0d48-490e-9a8f-6d42c65510bc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.739999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0270a6-0d48-490e-9a8f-6d42c65510bc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.740310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0270a6-0d48-490e-9a8f-6d42c65510bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.741609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0270a6-0d48-490e-9a8f-6d42c65510bc None admin] RBAC: Adding query filter params (role.id=cb911cef057e44fb9c8004a419568df8, user.id=7db43e280dae4a1fb6b975fd43b41fd1, scope.system=all) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:27.741929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0270a6-0d48-490e-9a8f-6d42c65510bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:27.743442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0270a6-0d48-490e-9a8f-6d42c65510bc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:27.750677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 142/282] 10.222.0.71 () {56 vars in 1308 bytes} [Mon Aug 1 15:23:27 2022] GET /identity/v3/role_assignments?user.id=7db43e280dae4a1fb6b975fd43b41fd1&scope.system=all&role.id=cb911cef057e44fb9c8004a419568df8 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:27.859410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9cb00-05b9-4b3b-a06c-f654130bdbf7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.859620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9cb00-05b9-4b3b-a06c-f654130bdbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.860056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9cb00-05b9-4b3b-a06c-f654130bdbf7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.861815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 143/283] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:27.876886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532ac0-1e1c-4aff-b81b-7193326bda63 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.877340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532ac0-1e1c-4aff-b81b-7193326bda63 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.877606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532ac0-1e1c-4aff-b81b-7193326bda63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.887816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.902599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e6f1c-f34d-41da-a8b1-60818e93e48a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:27.914275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1b532ac0-1e1c-4aff-b81b-7193326bda63 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:27.921236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1b532ac0-1e1c-4aff-b81b-7193326bda63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:27.996307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:27.997133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:27.997427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:27.997766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:27.998811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:27.999126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:28.000575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:28.012702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 141/284] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:28.020106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:28.086757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 144/285] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:28.121399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b532ac0-1e1c-4aff-b81b-7193326bda63 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:28.139543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56ed0-089a-4765-bd3d-4ed98e18fe87 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:28.183986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305247ef-592e-47cc-81b7-0f8fe1c788c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:28.184786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305247ef-592e-47cc-81b7-0f8fe1c788c2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:28.185513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305247ef-592e-47cc-81b7-0f8fe1c788c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:28.186215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305247ef-592e-47cc-81b7-0f8fe1c788c2 None admin] PATH_INFO: `/v3/users/eb22ff911c3949cba76b0b40454a6c40` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:28.187540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305247ef-592e-47cc-81b7-0f8fe1c788c2 None admin] RBAC: Authorizing `identity:get_user(user_id=eb22ff911c3949cba76b0b40454a6c40)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:28.189305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305247ef-592e-47cc-81b7-0f8fe1c788c2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:28.195689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 142/286] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:28 2022] GET /identity/v3/users/eb22ff911c3949cba76b0b40454a6c40 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:28.199272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305247ef-592e-47cc-81b7-0f8fe1c788c2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:28.222963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:28.318311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305247ef-592e-47cc-81b7-0f8fe1c788c2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:28.362120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79246c38-2a43-43e8-bc84-a85f0cbbacba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:28.362778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246c38-2a43-43e8-bc84-a85f0cbbacba None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:28.363063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246c38-2a43-43e8-bc84-a85f0cbbacba None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:28.363338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246c38-2a43-43e8-bc84-a85f0cbbacba None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:28.367934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79246c38-2a43-43e8-bc84-a85f0cbbacba None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:28.371205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79246c38-2a43-43e8-bc84-a85f0cbbacba None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:28.376263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 143/287] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:28 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:28.400837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79246c38-2a43-43e8-bc84-a85f0cbbacba None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:28.411515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b532ac0-1e1c-4aff-b81b-7193326bda63 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:28.472112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:28.500054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c41db-07c3-427b-8476-1be55c3f3c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:28.500817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c41db-07c3-427b-8476-1be55c3f3c61 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:28.501285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c41db-07c3-427b-8476-1be55c3f3c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:28.501566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c41db-07c3-427b-8476-1be55c3f3c61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:28.532048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c41db-07c3-427b-8476-1be55c3f3c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ef0c41db-07c3-427b-8476-1be55c3f3c61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:28.537504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:28.538410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:28.539973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:28.542632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 145/288] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:28.552383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c41db-07c3-427b-8476-1be55c3f3c61 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:28.559397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:28.570838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79246c38-2a43-43e8-bc84-a85f0cbbacba None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:28.653288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970ffc7-e49b-4d3b-b170-efad4a130698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:28.653893 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970ffc7-e49b-4d3b-b170-efad4a130698 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:28.654176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970ffc7-e49b-4d3b-b170-efad4a130698 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:28.654452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970ffc7-e49b-4d3b-b170-efad4a130698 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/users/eb22ff911c3949cba76b0b40454a6c40/roles/c31070d0b9f143a49945c541a812a52e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:28.656533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970ffc7-e49b-4d3b-b170-efad4a130698 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5, user_id=eb22ff911c3949cba76b0b40454a6c40, role_id=c31070d0b9f143a49945c541a812a52e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:28.658076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970ffc7-e49b-4d3b-b170-efad4a130698 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:28.689053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 144/289] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:23:28 2022] PUT /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/users/eb22ff911c3949cba76b0b40454a6c40/roles/c31070d0b9f143a49945c541a812a52e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:23:28.713382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c41db-07c3-427b-8476-1be55c3f3c61 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:28.751864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:28.752601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:28.752863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:28.753140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:28.753866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:28.754173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:28.755584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:28.765772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 146/290] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:28.772161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970ffc7-e49b-4d3b-b170-efad4a130698 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:28.942288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970ffc7-e49b-4d3b-b170-efad4a130698 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:28.984008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fd8d9-4aa8-4b69-8a36-d55e7e436478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:28.984952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd8d9-4aa8-4b69-8a36-d55e7e436478 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:28.985277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd8d9-4aa8-4b69-8a36-d55e7e436478 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:28.985585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd8d9-4aa8-4b69-8a36-d55e7e436478 None admin] PATH_INFO: `/v3/users/030227600d9e4adaaf9fef686ea82b8b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:28.987574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fd8d9-4aa8-4b69-8a36-d55e7e436478 None admin] RBAC: Authorizing `identity:get_user(user_id=030227600d9e4adaaf9fef686ea82b8b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:28.989970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fd8d9-4aa8-4b69-8a36-d55e7e436478 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:28.992783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 145/291] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:28 2022] GET /identity/v3/users/030227600d9e4adaaf9fef686ea82b8b => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:28.998641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:29.066790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:29.148645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7c48a-6edd-4071-8482-8f5db564facb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:29.199912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32625b69-80b7-4f42-b3a5-f995ccbe7769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:29.200529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32625b69-80b7-4f42-b3a5-f995ccbe7769 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:29.200815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32625b69-80b7-4f42-b3a5-f995ccbe7769 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:29.201091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32625b69-80b7-4f42-b3a5-f995ccbe7769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:29.307897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32625b69-80b7-4f42-b3a5-f995ccbe7769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:29.309605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32625b69-80b7-4f42-b3a5-f995ccbe7769 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:29.375299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:29.449048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 147/292] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:29.450394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fd8d9-4aa8-4b69-8a36-d55e7e436478 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:29.482411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:29.608565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fd8d9-4aa8-4b69-8a36-d55e7e436478 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:29.659327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ad62-eb71-4c47-8d56-31a0b7f2300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:29.659999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ad62-eb71-4c47-8d56-31a0b7f2300f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:29.660283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ad62-eb71-4c47-8d56-31a0b7f2300f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:29.660563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ad62-eb71-4c47-8d56-31a0b7f2300f None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:29.662672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ad62-eb71-4c47-8d56-31a0b7f2300f None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:29.664951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ad62-eb71-4c47-8d56-31a0b7f2300f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:29.667638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 146/293] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:29 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:29.672381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32625b69-80b7-4f42-b3a5-f995ccbe7769 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:29.813389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32625b69-80b7-4f42-b3a5-f995ccbe7769 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:29.862412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9a5bb-d978-450a-ad18-799c0b2dd82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:29.863052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9a5bb-d978-450a-ad18-799c0b2dd82a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:29.863338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9a5bb-d978-450a-ad18-799c0b2dd82a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:29.863648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9a5bb-d978-450a-ad18-799c0b2dd82a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:29.864448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9a5bb-d978-450a-ad18-799c0b2dd82a None admin] RBAC: Adding query filter params (role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5, user.id=030227600d9e4adaaf9fef686ea82b8b) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:29.864760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9a5bb-d978-450a-ad18-799c0b2dd82a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:29.866209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9a5bb-d978-450a-ad18-799c0b2dd82a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:29.872844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 148/294] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:29 2022] GET /identity/v3/role_assignments?user.id=030227600d9e4adaaf9fef686ea82b8b&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=cb911cef057e44fb9c8004a419568df8 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:29.955502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7a24-6628-432f-8674-2ca551c8528c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:29.955822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7a24-6628-432f-8674-2ca551c8528c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:29.956057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7a24-6628-432f-8674-2ca551c8528c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:29.957452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 147/295] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:29.964261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af60e4-689d-4565-a1eb-8f27bf643b03 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:29.964593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af60e4-689d-4565-a1eb-8f27bf643b03 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:29.964830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af60e4-689d-4565-a1eb-8f27bf643b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:29.994065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-60af60e4-689d-4565-a1eb-8f27bf643b03 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:29.995316 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-60af60e4-689d-4565-a1eb-8f27bf643b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:29.998747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:30.006442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126693d4-978d-42ed-b61b-7ecc91829f94 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.006802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126693d4-978d-42ed-b61b-7ecc91829f94 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.007055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126693d4-978d-42ed-b61b-7ecc91829f94 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.008916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 148/296] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:30.029241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba4109-6362-4f7b-8009-c90fc19956fb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.029555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba4109-6362-4f7b-8009-c90fc19956fb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.029793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba4109-6362-4f7b-8009-c90fc19956fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.054400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-30ba4109-6362-4f7b-8009-c90fc19956fb None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:30.055737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-30ba4109-6362-4f7b-8009-c90fc19956fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:30.108370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 149/297] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:30.140177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af60e4-689d-4565-a1eb-8f27bf643b03 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:30.154906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 149/298] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:30.156249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0561f9-d585-477c-8d6f-9d92b985ee61 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.156543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0561f9-d585-477c-8d6f-9d92b985ee61 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.156814 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0561f9-d585-477c-8d6f-9d92b985ee61 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.158091 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 150/299] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:30.169519 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa017c0f-93e7-439d-bf9a-ecac46386b03 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.169890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa017c0f-93e7-439d-bf9a-ecac46386b03 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.170228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa017c0f-93e7-439d-bf9a-ecac46386b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.203197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aa017c0f-93e7-439d-bf9a-ecac46386b03 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:30.204436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aa017c0f-93e7-439d-bf9a-ecac46386b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:30.215205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:30.271007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af60e4-689d-4565-a1eb-8f27bf643b03 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:30.287801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 151/300] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:30.287801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa017c0f-93e7-439d-bf9a-ecac46386b03 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:30.316310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77ae19-98ae-4211-92b8-65744914e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:30.316979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77ae19-98ae-4211-92b8-65744914e266 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.317267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77ae19-98ae-4211-92b8-65744914e266 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.317543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77ae19-98ae-4211-92b8-65744914e266 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.325759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:30.330116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77ae19-98ae-4211-92b8-65744914e266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8d77ae19-98ae-4211-92b8-65744914e266 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:30.335740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:30.336699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:30.337464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 150/301] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:30.342888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77ae19-98ae-4211-92b8-65744914e266 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:30.406440 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa017c0f-93e7-439d-bf9a-ecac46386b03 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:30.459017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afba1b-96f5-4870-8ca9-2720be025265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:30.459780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afba1b-96f5-4870-8ca9-2720be025265 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.460135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afba1b-96f5-4870-8ca9-2720be025265 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.460495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afba1b-96f5-4870-8ca9-2720be025265 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.461860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afba1b-96f5-4870-8ca9-2720be025265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:30.463638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afba1b-96f5-4870-8ca9-2720be025265 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:30.470109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 152/302] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:30.470109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afba1b-96f5-4870-8ca9-2720be025265 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:30.473889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77ae19-98ae-4211-92b8-65744914e266 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:30.479919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:30.518944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7147f-1a6d-4859-9b29-5294efdbed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:30.520347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7147f-1a6d-4859-9b29-5294efdbed77 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.520784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7147f-1a6d-4859-9b29-5294efdbed77 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.521206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7147f-1a6d-4859-9b29-5294efdbed77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.535605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7147f-1a6d-4859-9b29-5294efdbed77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c8a7147f-1a6d-4859-9b29-5294efdbed77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:30.542723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:30.543770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:30.546096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:30.549783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 151/303] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:30.550757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7147f-1a6d-4859-9b29-5294efdbed77 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:30.584872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afba1b-96f5-4870-8ca9-2720be025265 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:30.655485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:30.656902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.657281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.657571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.658798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:30.659319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:30.661890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:30.676654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:30.677954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 153/304] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:30.679731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:30.747010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7147f-1a6d-4859-9b29-5294efdbed77 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:30.771708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:30.792473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0e88d-9b37-435a-a383-7ef1bcf66419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:30.793118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e88d-9b37-435a-a383-7ef1bcf66419 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.793400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e88d-9b37-435a-a383-7ef1bcf66419 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.793680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e88d-9b37-435a-a383-7ef1bcf66419 None admin] PATH_INFO: `/v3/groups` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.794361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0e88d-9b37-435a-a383-7ef1bcf66419 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:30.795920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0e88d-9b37-435a-a383-7ef1bcf66419 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:30.808728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669212cc-89a3-43d3-bda6-f8d20b623b3f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:30.823421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 152/305] 10.222.0.71 () {60 vars in 1134 bytes} [Mon Aug 1 15:23:30 2022] POST /identity/v3/groups => generated 229 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:30.823421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0e88d-9b37-435a-a383-7ef1bcf66419 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:30.867067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:30.868266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:30.868784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:30.869317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:30.871788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:30.872311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:30.874714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:30.889013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 154/306] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:30.897081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:30.957241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0e88d-9b37-435a-a383-7ef1bcf66419 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:30.984255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:31.005878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aa3cb-cacc-41e2-aa33-72ee91e382a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:31.006793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aa3cb-cacc-41e2-aa33-72ee91e382a8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:31.007877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aa3cb-cacc-41e2-aa33-72ee91e382a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:31.008223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aa3cb-cacc-41e2-aa33-72ee91e382a8 None admin] PATH_INFO: `/v3/users/3ca67e4c0ed14eaa8798d6182f2a4008` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:31.029886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aa3cb-cacc-41e2-aa33-72ee91e382a8 None admin] RBAC: Authorizing `identity:get_user(user_id=3ca67e4c0ed14eaa8798d6182f2a4008)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:31.031171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aa3cb-cacc-41e2-aa33-72ee91e382a8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:31.032964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 153/307] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:30 2022] GET /identity/v3/users/3ca67e4c0ed14eaa8798d6182f2a4008 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:31.041312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aa3cb-cacc-41e2-aa33-72ee91e382a8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:31.063294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9305-c3fb-45b3-b2d6-00b04875d3a2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:31.117952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8761d9-e17c-4851-923c-cf6cb61450c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:31.118572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8761d9-e17c-4851-923c-cf6cb61450c0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:31.118856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8761d9-e17c-4851-923c-cf6cb61450c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:31.119135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8761d9-e17c-4851-923c-cf6cb61450c0 None admin] PATH_INFO: `/v3/users/7db43e280dae4a1fb6b975fd43b41fd1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:31.120376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8761d9-e17c-4851-923c-cf6cb61450c0 None admin] RBAC: Authorizing `identity:get_user(user_id=7db43e280dae4a1fb6b975fd43b41fd1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:31.121829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8761d9-e17c-4851-923c-cf6cb61450c0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:31.123493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 155/308] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:30 2022] GET /identity/v3/users/7db43e280dae4a1fb6b975fd43b41fd1 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:31.129121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8761d9-e17c-4851-923c-cf6cb61450c0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:31.137217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:31.187152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aa3cb-cacc-41e2-aa33-72ee91e382a8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:31.249380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3a957-b481-49c6-8a6b-dfe93f06f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:31.250224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a957-b481-49c6-8a6b-dfe93f06f83a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:31.250674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a957-b481-49c6-8a6b-dfe93f06f83a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:31.251095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a957-b481-49c6-8a6b-dfe93f06f83a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:31.252217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3a957-b481-49c6-8a6b-dfe93f06f83a None admin] RBAC: Adding query filter params (role.id=c31070d0b9f143a49945c541a812a52e, user.id=3ca67e4c0ed14eaa8798d6182f2a4008, scope.system=all) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:31.252710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3a957-b481-49c6-8a6b-dfe93f06f83a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:31.255068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3a957-b481-49c6-8a6b-dfe93f06f83a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:31.263591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 154/309] 10.222.0.71 () {56 vars in 1308 bytes} [Mon Aug 1 15:23:31 2022] GET /identity/v3/role_assignments?user.id=3ca67e4c0ed14eaa8798d6182f2a4008&scope.system=all&role.id=c31070d0b9f143a49945c541a812a52e => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:31.302992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8761d9-e17c-4851-923c-cf6cb61450c0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:31.306239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fb52c-d493-43e7-a739-72b28422eecd None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:31.306554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fb52c-d493-43e7-a739-72b28422eecd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:31.306800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fb52c-d493-43e7-a739-72b28422eecd None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:31.308426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 155/310] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:31.316561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25929a0-66a4-4bce-b739-cad5298a9a1a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:31.316866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25929a0-66a4-4bce-b739-cad5298a9a1a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:31.317130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25929a0-66a4-4bce-b739-cad5298a9a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:31.347815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e25929a0-66a4-4bce-b739-cad5298a9a1a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:31.349068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e25929a0-66a4-4bce-b739-cad5298a9a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:31.353533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b827b-fd00-405a-b1b9-fc6be743cd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:31.354561 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b827b-fd00-405a-b1b9-fc6be743cd7a None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:31.355126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b827b-fd00-405a-b1b9-fc6be743cd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:31.355633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b827b-fd00-405a-b1b9-fc6be743cd7a None admin] PATH_INFO: `/v3/system/users/7db43e280dae4a1fb6b975fd43b41fd1/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:31.357551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b827b-fd00-405a-b1b9-fc6be743cd7a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7db43e280dae4a1fb6b975fd43b41fd1, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:31.359791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b827b-fd00-405a-b1b9-fc6be743cd7a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:31.374840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 156/311] 10.222.0.71 () {58 vars in 1334 bytes} [Mon Aug 1 15:23:31 2022] PUT /identity/v3/system/users/7db43e280dae4a1fb6b975fd43b41fd1/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:23:31.410460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:31.459680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 156/312] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:31.485773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b827b-fd00-405a-b1b9-fc6be743cd7a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:31.573935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:31.619631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b827b-fd00-405a-b1b9-fc6be743cd7a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:31.659147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27b64-c3f4-472e-b758-186a6484c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:31.659900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27b64-c3f4-472e-b758-186a6484c71e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:31.660185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27b64-c3f4-472e-b758-186a6484c71e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:31.660464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27b64-c3f4-472e-b758-186a6484c71e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:31.672202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee27b64-c3f4-472e-b758-186a6484c71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cee27b64-c3f4-472e-b758-186a6484c71e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:31.677696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:31.678531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:31.679897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 157/313] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:31.689028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25929a0-66a4-4bce-b739-cad5298a9a1a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:31.801771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25929a0-66a4-4bce-b739-cad5298a9a1a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:31.838663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:31.839271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:31.839506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:31.839845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:31.840566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:31.840922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:31.842385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:31.852381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 157/314] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:31.858073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27b64-c3f4-472e-b758-186a6484c71e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:31.978196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27b64-c3f4-472e-b758-186a6484c71e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:32.009872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:32.021301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94030-6ec2-4e70-bd00-3bf130b1d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:32.021951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94030-6ec2-4e70-bd00-3bf130b1d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:32.022229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94030-6ec2-4e70-bd00-3bf130b1d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:32.022504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94030-6ec2-4e70-bd00-3bf130b1d5b3 None admin] PATH_INFO: `/v3/users/eb22ff911c3949cba76b0b40454a6c40` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:32.023831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b94030-6ec2-4e70-bd00-3bf130b1d5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=eb22ff911c3949cba76b0b40454a6c40)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:32.025492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b94030-6ec2-4e70-bd00-3bf130b1d5b3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:32.027137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 158/315] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:31 2022] GET /identity/v3/users/eb22ff911c3949cba76b0b40454a6c40 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:32.033170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:32.078479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:32.156410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667460c7-e71a-4f17-bc9a-de855ba60e20 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:32.193813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78146b-9c0e-4c98-b7ed-9ab7554f48fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:32.195330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78146b-9c0e-4c98-b7ed-9ab7554f48fb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:32.195866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78146b-9c0e-4c98-b7ed-9ab7554f48fb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:32.196340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78146b-9c0e-4c98-b7ed-9ab7554f48fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:32.275270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78146b-9c0e-4c98-b7ed-9ab7554f48fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:32.276796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78146b-9c0e-4c98-b7ed-9ab7554f48fb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:32.312432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:32.387818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 158/316] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:32.393245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94030-6ec2-4e70-bd00-3bf130b1d5b3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:32.508824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94030-6ec2-4e70-bd00-3bf130b1d5b3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:32.544248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43871c7-7b56-4d66-ab2b-28813a37d928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:32.544926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43871c7-7b56-4d66-ab2b-28813a37d928 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:32.545214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43871c7-7b56-4d66-ab2b-28813a37d928 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:32.545494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43871c7-7b56-4d66-ab2b-28813a37d928 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:32.546855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43871c7-7b56-4d66-ab2b-28813a37d928 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:32.548432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43871c7-7b56-4d66-ab2b-28813a37d928 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:32.550696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 159/317] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:32 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:32.558186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78146b-9c0e-4c98-b7ed-9ab7554f48fb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:32.673048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78146b-9c0e-4c98-b7ed-9ab7554f48fb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:32.711491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4030f-3784-458c-98ac-26834da66748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:32.712499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4030f-3784-458c-98ac-26834da66748 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:32.713005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4030f-3784-458c-98ac-26834da66748 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:32.713479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4030f-3784-458c-98ac-26834da66748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:32.714480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4030f-3784-458c-98ac-26834da66748 None admin] RBAC: Adding query filter params (role.id=c31070d0b9f143a49945c541a812a52e, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5, user.id=eb22ff911c3949cba76b0b40454a6c40) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:32.715020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4030f-3784-458c-98ac-26834da66748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:32.716727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4030f-3784-458c-98ac-26834da66748 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:32.718932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:32.726951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 159/318] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:23:32 2022] GET /identity/v3/role_assignments?user.id=eb22ff911c3949cba76b0b40454a6c40&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=c31070d0b9f143a49945c541a812a52e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:33.183061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb380a-99b2-41b4-b75c-e5d027f6185f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.183342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb380a-99b2-41b4-b75c-e5d027f6185f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.183845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb380a-99b2-41b4-b75c-e5d027f6185f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.185363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 160/319] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:33.190667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24de45-07dd-4086-ab6c-a95afb4562a2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.191111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24de45-07dd-4086-ab6c-a95afb4562a2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.191216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24de45-07dd-4086-ab6c-a95afb4562a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.212545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6b24de45-07dd-4086-ab6c-a95afb4562a2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:33.213984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6b24de45-07dd-4086-ab6c-a95afb4562a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:33.309327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 160/320] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:33.332178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb380a-99b2-41b4-b75c-e5d027f6185f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:33.404325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:33.449235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb380a-99b2-41b4-b75c-e5d027f6185f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:33.479838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3ccf-3fdc-4e80-b6e4-f906dff6ba93 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.480195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3ccf-3fdc-4e80-b6e4-f906dff6ba93 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.480662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3ccf-3fdc-4e80-b6e4-f906dff6ba93 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.482159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 161/321] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:33.483252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bcfdc-d35d-4e28-af75-99c253ab9c41 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.483555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bcfdc-d35d-4e28-af75-99c253ab9c41 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.483904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bcfdc-d35d-4e28-af75-99c253ab9c41 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.485209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 162/322] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:33.487883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956c2e3-6b82-4ef5-8503-19785f1ede66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:33.488045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381ad5-76c4-42d3-8cf1-c47d0089f5b2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.488240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381ad5-76c4-42d3-8cf1-c47d0089f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.488446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381ad5-76c4-42d3-8cf1-c47d0089f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.488538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c2e3-6b82-4ef5-8503-19785f1ede66 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.488805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c2e3-6b82-4ef5-8503-19785f1ede66 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.489104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c2e3-6b82-4ef5-8503-19785f1ede66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.490277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956c2e3-6b82-4ef5-8503-19785f1ede66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:33.491777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956c2e3-6b82-4ef5-8503-19785f1ede66 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:33.493375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 161/323] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:33.494518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd14b-12aa-417b-8c1f-865c83857074 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.494803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd14b-12aa-417b-8c1f-865c83857074 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.495078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd14b-12aa-417b-8c1f-865c83857074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.507644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ce381ad5-76c4-42d3-8cf1-c47d0089f5b2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:33.508854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ce381ad5-76c4-42d3-8cf1-c47d0089f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:33.513453 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b0ccd14b-12aa-417b-8c1f-865c83857074 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:33.514609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b0ccd14b-12aa-417b-8c1f-865c83857074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:33.583635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 163/324] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:33.583839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 162/325] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:33.584469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381ad5-76c4-42d3-8cf1-c47d0089f5b2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:33.606304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccd14b-12aa-417b-8c1f-865c83857074 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:33.654619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:33.677868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:33.712413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381ad5-76c4-42d3-8cf1-c47d0089f5b2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:33.732924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccd14b-12aa-417b-8c1f-865c83857074 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:33.748834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015ec9-eecd-4092-b75e-78cc42cea054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:33.749464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015ec9-eecd-4092-b75e-78cc42cea054 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.749747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015ec9-eecd-4092-b75e-78cc42cea054 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.750024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015ec9-eecd-4092-b75e-78cc42cea054 None admin] PATH_INFO: `/v3/groups` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.750687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9015ec9-eecd-4092-b75e-78cc42cea054 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:33.752188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9015ec9-eecd-4092-b75e-78cc42cea054 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:33.768911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 164/326] 10.222.0.71 () {60 vars in 1134 bytes} [Mon Aug 1 15:23:33 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:33.768911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015ec9-eecd-4092-b75e-78cc42cea054 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:33.784229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a420f0-aa72-437a-8300-35108dad470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:33.785260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a420f0-aa72-437a-8300-35108dad470e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.785657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a420f0-aa72-437a-8300-35108dad470e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.786049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a420f0-aa72-437a-8300-35108dad470e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.802870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a420f0-aa72-437a-8300-35108dad470e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a8a420f0-aa72-437a-8300-35108dad470e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:33.811632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:33.812601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:33.813428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 163/327] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:33.822484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a420f0-aa72-437a-8300-35108dad470e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:33.923880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015ec9-eecd-4092-b75e-78cc42cea054 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:33.942794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:33.956038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a420f0-aa72-437a-8300-35108dad470e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:33.967632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051d6e7-8bf4-40e9-8cac-2adfb5fe9c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:33.968484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051d6e7-8bf4-40e9-8cac-2adfb5fe9c90 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:33.968875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051d6e7-8bf4-40e9-8cac-2adfb5fe9c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:33.969211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051d6e7-8bf4-40e9-8cac-2adfb5fe9c90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:33.983495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051d6e7-8bf4-40e9-8cac-2adfb5fe9c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:33.983676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7051d6e7-8bf4-40e9-8cac-2adfb5fe9c90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:33.987210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:33.988476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:33.989253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:33.989838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 165/328] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:33.996100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051d6e7-8bf4-40e9-8cac-2adfb5fe9c90 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:34.005272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:34.005901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:34.006177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:34.006459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:34.008087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:34.008196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:34.009627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:34.018259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 164/329] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:34.031448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:34.153917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051d6e7-8bf4-40e9-8cac-2adfb5fe9c90 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:34.177328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be00a9b-d71d-4caf-b237-234765e0ace2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:34.206349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:34.207553 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:34.207841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:34.208121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:34.209113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:34.209918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:34.212805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:34.224355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 166/330] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:34.229828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:34.231813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae003a-ff75-449d-a976-02695e62e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:34.232486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae003a-ff75-449d-a976-02695e62e5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:34.232770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae003a-ff75-449d-a976-02695e62e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:34.233048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae003a-ff75-449d-a976-02695e62e5a3 None admin] PATH_INFO: `/v3/users/3ca67e4c0ed14eaa8798d6182f2a4008` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:34.237523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae003a-ff75-449d-a976-02695e62e5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=3ca67e4c0ed14eaa8798d6182f2a4008)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:34.239139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae003a-ff75-449d-a976-02695e62e5a3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:34.240840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 165/331] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:34 2022] GET /identity/v3/users/3ca67e4c0ed14eaa8798d6182f2a4008 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:34.251686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae003a-ff75-449d-a976-02695e62e5a3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:34.300548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:34.318987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:34.389774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0640824-8f66-485b-8df8-26bba577c21b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:34.398012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae003a-ff75-449d-a976-02695e62e5a3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:34.443299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc65c7-2a42-46a4-a8c5-3971446709fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:34.444890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc65c7-2a42-46a4-a8c5-3971446709fd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:34.445627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc65c7-2a42-46a4-a8c5-3971446709fd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:34.446393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc65c7-2a42-46a4-a8c5-3971446709fd None admin] PATH_INFO: `/v3/users/7db43e280dae4a1fb6b975fd43b41fd1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:34.449787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc65c7-2a42-46a4-a8c5-3971446709fd None admin] RBAC: Authorizing `identity:get_user(user_id=7db43e280dae4a1fb6b975fd43b41fd1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:34.450669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc65c7-2a42-46a4-a8c5-3971446709fd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:34.452381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 167/332] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:34 2022] GET /identity/v3/users/7db43e280dae4a1fb6b975fd43b41fd1 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:34.457505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a48d4-ff37-4146-aeb1-514ab84561c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:34.458576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc65c7-2a42-46a4-a8c5-3971446709fd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:34.458685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a48d4-ff37-4146-aeb1-514ab84561c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:34.459167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a48d4-ff37-4146-aeb1-514ab84561c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:34.459743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a48d4-ff37-4146-aeb1-514ab84561c2 None admin] PATH_INFO: `/v3/system/users/3ca67e4c0ed14eaa8798d6182f2a4008/roles/c31070d0b9f143a49945c541a812a52e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:34.462335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a48d4-ff37-4146-aeb1-514ab84561c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3ca67e4c0ed14eaa8798d6182f2a4008, role_id=c31070d0b9f143a49945c541a812a52e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:34.464884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a48d4-ff37-4146-aeb1-514ab84561c2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:34.480660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 166/333] 10.222.0.71 () {58 vars in 1334 bytes} [Mon Aug 1 15:23:34 2022] PUT /identity/v3/system/users/3ca67e4c0ed14eaa8798d6182f2a4008/roles/c31070d0b9f143a49945c541a812a52e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:34.575973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc65c7-2a42-46a4-a8c5-3971446709fd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:34.588271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:34.626162 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e8401-dcf1-4263-9d96-29b783bf0176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:34.626808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8401-dcf1-4263-9d96-29b783bf0176 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:34.627197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8401-dcf1-4263-9d96-29b783bf0176 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:34.627517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8401-dcf1-4263-9d96-29b783bf0176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:34.628340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8401-dcf1-4263-9d96-29b783bf0176 None admin] RBAC: Adding query filter params (role.id=cb911cef057e44fb9c8004a419568df8, user.id=7db43e280dae4a1fb6b975fd43b41fd1, scope.system=all) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:34.628659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8401-dcf1-4263-9d96-29b783bf0176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:34.630191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8401-dcf1-4263-9d96-29b783bf0176 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:34.645687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 168/334] 10.222.0.71 () {56 vars in 1308 bytes} [Mon Aug 1 15:23:34 2022] GET /identity/v3/role_assignments?user.id=7db43e280dae4a1fb6b975fd43b41fd1&scope.system=all&role.id=cb911cef057e44fb9c8004a419568df8 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:36.187063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef8cd8-9cf1-4741-9638-995e58526a82 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:36.187638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef8cd8-9cf1-4741-9638-995e58526a82 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:36.187638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef8cd8-9cf1-4741-9638-995e58526a82 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:36.189294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 167/335] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:36.195609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc357eb-a266-43c5-91c4-9cce391104b2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:36.196061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc357eb-a266-43c5-91c4-9cce391104b2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:36.196477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc357eb-a266-43c5-91c4-9cce391104b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:36.224430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1dc357eb-a266-43c5-91c4-9cce391104b2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:36.225653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1dc357eb-a266-43c5-91c4-9cce391104b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:36.325024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 169/336] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:36.380958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef8cd8-9cf1-4741-9638-995e58526a82 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:36.496365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef8cd8-9cf1-4741-9638-995e58526a82 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:36.512278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:36.538049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f32f36-ceca-4356-8d74-b9e16bebba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:36.538736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32f36-ceca-4356-8d74-b9e16bebba66 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:36.539021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32f36-ceca-4356-8d74-b9e16bebba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:36.539302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32f36-ceca-4356-8d74-b9e16bebba66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:36.560296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f32f36-ceca-4356-8d74-b9e16bebba66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-32f32f36-ceca-4356-8d74-b9e16bebba66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:36.566210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:36.567079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:36.567863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 168/337] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:36.573968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc357eb-a266-43c5-91c4-9cce391104b2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:36.693503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:36.704679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc357eb-a266-43c5-91c4-9cce391104b2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:36.747672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8a200-0737-4892-a491-c9c52cae633d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:36.747947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8a200-0737-4892-a491-c9c52cae633d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:36.748154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8a200-0737-4892-a491-c9c52cae633d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:36.749529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 169/338] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:36.756349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5396fb-5d64-4087-bd5b-07f1f237ab07 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:36.756715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5396fb-5d64-4087-bd5b-07f1f237ab07 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:36.757026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5396fb-5d64-4087-bd5b-07f1f237ab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:36.758897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:36.759570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:36.759958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:36.760244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:36.760984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:36.761291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:36.762688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:36.772715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 170/339] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:36.784518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:36.802888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3c5396fb-5d64-4087-bd5b-07f1f237ab07 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:36.805587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3c5396fb-5d64-4087-bd5b-07f1f237ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:36.889228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 170/340] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:36.942490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47448e-f175-4578-93ee-98c1bb5f1dd4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:36.965717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5396fb-5d64-4087-bd5b-07f1f237ab07 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:36.983083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2458f-1752-473a-b534-43b4f2c74ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:36.983751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2458f-1752-473a-b534-43b4f2c74ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:36.984037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2458f-1752-473a-b534-43b4f2c74ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:36.984314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2458f-1752-473a-b534-43b4f2c74ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.027302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:37.082061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2458f-1752-473a-b534-43b4f2c74ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:37.083578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2458f-1752-473a-b534-43b4f2c74ae5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:37.164910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5396fb-5d64-4087-bd5b-07f1f237ab07 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:37.172575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:37.226844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 171/341] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:37.234982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2458f-1752-473a-b534-43b4f2c74ae5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:37.284267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0672-9f6f-4454-9cb0-85e6ab6552de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:37.284940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0672-9f6f-4454-9cb0-85e6ab6552de None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.285153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0672-9f6f-4454-9cb0-85e6ab6552de None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.285421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0672-9f6f-4454-9cb0-85e6ab6552de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.312022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a0672-9f6f-4454-9cb0-85e6ab6552de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-746a0672-9f6f-4454-9cb0-85e6ab6552de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:37.317787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:37.318659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:37.320015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 171/342] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:37.328092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0672-9f6f-4454-9cb0-85e6ab6552de None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:37.338390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:37.443177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2458f-1752-473a-b534-43b4f2c74ae5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:37.538029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fa027-c47b-4970-9716-be70bca72284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:37.538640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fa027-c47b-4970-9716-be70bca72284 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.538923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fa027-c47b-4970-9716-be70bca72284 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.539199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fa027-c47b-4970-9716-be70bca72284 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.545243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fa027-c47b-4970-9716-be70bca72284 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:37.546723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fa027-c47b-4970-9716-be70bca72284 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:37.552116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 172/343] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:37 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:37.553361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc8e3-a6f7-4130-baed-2756ecb78342 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.553648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc8e3-a6f7-4130-baed-2756ecb78342 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.554182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc8e3-a6f7-4130-baed-2756ecb78342 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.556680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 173/344] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:37.558181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cc8e3-a6f7-4130-baed-2756ecb78342 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:37.568027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0672-9f6f-4454-9cb0-85e6ab6552de None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:37.623075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d1b9d-2c07-4173-98d3-9808f27ede7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:37.623799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1b9d-2c07-4173-98d3-9808f27ede7e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.624086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1b9d-2c07-4173-98d3-9808f27ede7e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.624360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1b9d-2c07-4173-98d3-9808f27ede7e None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.625106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1b9d-2c07-4173-98d3-9808f27ede7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:37.625476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1b9d-2c07-4173-98d3-9808f27ede7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:37.627234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1b9d-2c07-4173-98d3-9808f27ede7e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:37.637803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 172/345] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:37.638856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b13fc-7cbe-429a-af87-e6c1f75f672a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.639153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b13fc-7cbe-429a-af87-e6c1f75f672a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.640393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b13fc-7cbe-429a-af87-e6c1f75f672a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.667557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c18b13fc-7cbe-429a-af87-e6c1f75f672a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:37.669402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c18b13fc-7cbe-429a-af87-e6c1f75f672a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:37.704406 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:37.736364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cc8e3-a6f7-4130-baed-2756ecb78342 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:37.762532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 173/346] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:37.764341 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc9044-d09b-44cb-a467-2753a7966623 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.764837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc9044-d09b-44cb-a467-2753a7966623 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.765499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc9044-d09b-44cb-a467-2753a7966623 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.771342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:37.772243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 174/347] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:37.773347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc9044-d09b-44cb-a467-2753a7966623 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:37.787508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3ad7-9b5f-414b-a368-3c5ce15f74c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:37.788589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3ad7-9b5f-414b-a368-3c5ce15f74c6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.789061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3ad7-9b5f-414b-a368-3c5ce15f74c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.789781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3ad7-9b5f-414b-a368-3c5ce15f74c6 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.797938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3ad7-9b5f-414b-a368-3c5ce15f74c6 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:37.799774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3ad7-9b5f-414b-a368-3c5ce15f74c6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:37.802094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 174/348] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:37 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:37.803148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3ad7-9b5f-414b-a368-3c5ce15f74c6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:37.897781 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc9044-d09b-44cb-a467-2753a7966623 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:37.921746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3ad7-9b5f-414b-a368-3c5ce15f74c6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:37.936288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3868ac7-3527-4001-87a0-f2cf1346d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:37.937000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3868ac7-3527-4001-87a0-f2cf1346d34c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.937475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3868ac7-3527-4001-87a0-f2cf1346d34c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.937777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3868ac7-3527-4001-87a0-f2cf1346d34c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.961273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9283f-b93e-467b-828a-80b1a5e36345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:37.962245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9283f-b93e-467b-828a-80b1a5e36345 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.962733 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9283f-b93e-467b-828a-80b1a5e36345 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.963232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9283f-b93e-467b-828a-80b1a5e36345 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:37.968168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:37.976361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9283f-b93e-467b-828a-80b1a5e36345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-23a9283f-b93e-467b-828a-80b1a5e36345 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:37.983394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:37.984341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:37.985124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:37.987491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 175/349] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:37.988982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c6d4-d3c8-4b74-87eb-6e04d0a5ccea None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:37.989507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c6d4-d3c8-4b74-87eb-6e04d0a5ccea None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:37.990061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c6d4-d3c8-4b74-87eb-6e04d0a5ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.011401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c191c6d4-d3c8-4b74-87eb-6e04d0a5ccea None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:38.013004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c191c6d4-d3c8-4b74-87eb-6e04d0a5ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:38.019546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3868ac7-3527-4001-87a0-f2cf1346d34c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:38.021025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3868ac7-3527-4001-87a0-f2cf1346d34c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:38.067034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:38.091291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 176/350] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:38.092488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191c6d4-d3c8-4b74-87eb-6e04d0a5ccea None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:38.153920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 175/351] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:38.153920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3868ac7-3527-4001-87a0-f2cf1346d34c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:38.216781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191c6d4-d3c8-4b74-87eb-6e04d0a5ccea None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:38.218742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:38.261780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:38.263087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.263724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.264207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.265320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] RBAC: Adding query filter params (group.id=115dd9e888f042c8859af8a380571482, role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=fc7e31d30c684107b874c500626aa093) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:38.265836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:38.267642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:38.275179 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 177/352] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:38 2022] GET /identity/v3/role_assignments?group.id=115dd9e888f042c8859af8a380571482&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=cb911cef057e44fb9c8004a419568df8 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:38.276316 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:38.281274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3868ac7-3527-4001-87a0-f2cf1346d34c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:38.323595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:38.324187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.324187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.324187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.324916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:38.325222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:38.326628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:38.336948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 176/353] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:38.337665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:38.338588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:38.405757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665667-347b-4318-ad17-16a386cf08f8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:38.449369 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71ba2b-fc76-493d-b632-4e513e9fb985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:38.450484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ba2b-fc76-493d-b632-4e513e9fb985 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.451068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ba2b-fc76-493d-b632-4e513e9fb985 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.451606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ba2b-fc76-493d-b632-4e513e9fb985 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.458527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16547-1cdc-4cdc-9929-23e8fb5f86ec None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:38.466635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71ba2b-fc76-493d-b632-4e513e9fb985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-dc71ba2b-fc76-493d-b632-4e513e9fb985 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:38.473418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:38.474410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:23:38.475195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:38.479135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 178/354] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:38.480306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71ba2b-fc76-493d-b632-4e513e9fb985 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:38.481672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:38.512683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb018625-ff16-4815-8267-7f0589a43661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:38.513399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018625-ff16-4815-8267-7f0589a43661 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.513688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018625-ff16-4815-8267-7f0589a43661 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.513969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018625-ff16-4815-8267-7f0589a43661 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.516535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb018625-ff16-4815-8267-7f0589a43661 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:38.518244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb018625-ff16-4815-8267-7f0589a43661 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:38.520416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 177/355] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:38 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:38.523037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dda9a-65ba-44e0-b135-856f7e99379a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.523388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dda9a-65ba-44e0-b135-856f7e99379a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.523743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dda9a-65ba-44e0-b135-856f7e99379a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.525808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 178/356] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:38.526694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dda9a-65ba-44e0-b135-856f7e99379a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:38.611763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71ba2b-fc76-493d-b632-4e513e9fb985 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:38.649136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:38.656717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93571590-84e0-43d3-9b6d-a6b0f8d98f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:38.657689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93571590-84e0-43d3-9b6d-a6b0f8d98f7c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.657986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93571590-84e0-43d3-9b6d-a6b0f8d98f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.658278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93571590-84e0-43d3-9b6d-a6b0f8d98f7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.664868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dda9a-65ba-44e0-b135-856f7e99379a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:38.717007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:38.718310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.718675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.719026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.719907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:38.720964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:38.723057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:38.736178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 179/357] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:38.736698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:38.759255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93571590-84e0-43d3-9b6d-a6b0f8d98f7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:38.761836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93571590-84e0-43d3-9b6d-a6b0f8d98f7c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:38.827026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:38.895282 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 179/358] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:38.897048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad6cd-8365-4fcc-991e-35fdff3f5e52 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.897335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad6cd-8365-4fcc-991e-35fdff3f5e52 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.898202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad6cd-8365-4fcc-991e-35fdff3f5e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.902771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23cfce-fdd5-4d06-87ed-49663d606bd6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:38.906530 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:38.924076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-817ad6cd-8365-4fcc-991e-35fdff3f5e52 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:38.925307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-817ad6cd-8365-4fcc-991e-35fdff3f5e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:38.953457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e0eec-bd20-435c-8d1b-e5f6456e9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:38.954413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0eec-bd20-435c-8d1b-e5f6456e9929 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:38.954880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0eec-bd20-435c-8d1b-e5f6456e9929 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:38.955236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0eec-bd20-435c-8d1b-e5f6456e9929 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:38.956455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e0eec-bd20-435c-8d1b-e5f6456e9929 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:38.957925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e0eec-bd20-435c-8d1b-e5f6456e9929 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:38.962910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 180/359] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:38 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:38.962910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e0eec-bd20-435c-8d1b-e5f6456e9929 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.020842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 180/360] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:39.022147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46f190-402c-45de-a449-b859aff6a5bd None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.022431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46f190-402c-45de-a449-b859aff6a5bd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.023263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46f190-402c-45de-a449-b859aff6a5bd None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.028654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 181/361] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:39.029445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46f190-402c-45de-a449-b859aff6a5bd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.104049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e0eec-bd20-435c-8d1b-e5f6456e9929 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.123576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:39.152873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca417-eeaa-40c4-8a4a-752b4c103af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:39.153462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca417-eeaa-40c4-8a4a-752b4c103af9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.153748 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca417-eeaa-40c4-8a4a-752b4c103af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.154031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca417-eeaa-40c4-8a4a-752b4c103af9 None admin] PATH_INFO: `/v3/users/3ca67e4c0ed14eaa8798d6182f2a4008` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.155336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca417-eeaa-40c4-8a4a-752b4c103af9 None admin] RBAC: Authorizing `identity:get_user(user_id=3ca67e4c0ed14eaa8798d6182f2a4008)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:39.156835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca417-eeaa-40c4-8a4a-752b4c103af9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:39.158652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 181/362] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:23:38 2022] GET /identity/v3/users/3ca67e4c0ed14eaa8798d6182f2a4008 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:39.159698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca417-eeaa-40c4-8a4a-752b4c103af9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.172810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46f190-402c-45de-a449-b859aff6a5bd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.223616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a903a-295c-4290-90df-79e7001f9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:39.224388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a903a-295c-4290-90df-79e7001f9a75 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.224740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a903a-295c-4290-90df-79e7001f9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.225475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a903a-295c-4290-90df-79e7001f9a75 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.226389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a903a-295c-4290-90df-79e7001f9a75 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:39.228006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a903a-295c-4290-90df-79e7001f9a75 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:39.230057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 182/363] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:39.231299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2fb81-a35c-42d6-bd0b-c168b7c24ae8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.231745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2fb81-a35c-42d6-bd0b-c168b7c24ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.232097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2fb81-a35c-42d6-bd0b-c168b7c24ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.238528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:39.253554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6bb2fb81-a35c-42d6-bd0b-c168b7c24ae8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:39.254764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6bb2fb81-a35c-42d6-bd0b-c168b7c24ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:39.295112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca417-eeaa-40c4-8a4a-752b4c103af9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.346602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:39.347238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.347659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.347933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.350133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] RBAC: Adding query filter params (group.id=115dd9e888f042c8859af8a380571482, role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=fc7e31d30c684107b874c500626aa093) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:39.350133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:39.350298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 183/364] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:39.350680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2fb81-a35c-42d6-bd0b-c168b7c24ae8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.350758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:39.357041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 182/365] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/role_assignments?group.id=115dd9e888f042c8859af8a380571482&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:39.357693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.419089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:39.488022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c913cb-5f19-4ddf-897b-fa1b54370a74 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.516226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2fb81-a35c-42d6-bd0b-c168b7c24ae8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.533005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:39.533790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.534071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.534344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.535162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] RBAC: Adding query filter params (role.id=c31070d0b9f143a49945c541a812a52e, user.id=3ca67e4c0ed14eaa8798d6182f2a4008, scope.system=all) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:39.535508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:39.536994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:39.551361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 183/366] 10.222.0.71 () {56 vars in 1308 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/role_assignments?user.id=3ca67e4c0ed14eaa8798d6182f2a4008&scope.system=all&role.id=c31070d0b9f143a49945c541a812a52e => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:39.552264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.561970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:39.571224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddc04-8265-43de-97c9-83ad5348e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:39.572276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddc04-8265-43de-97c9-83ad5348e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.572619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddc04-8265-43de-97c9-83ad5348e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.572997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddc04-8265-43de-97c9-83ad5348e1d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.592246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdddc04-8265-43de-97c9-83ad5348e1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8bdddc04-8265-43de-97c9-83ad5348e1d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:39.599074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:39.600088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:39.601415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 184/367] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:39.602069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddc04-8265-43de-97c9-83ad5348e1d0 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.720587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddc04-8265-43de-97c9-83ad5348e1d0 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.733126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432c8f-ede4-4654-a979-695391fab800 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.743021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:39.759493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e847-dec8-4f48-a449-b6d9a6b3e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:39.760512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e847-dec8-4f48-a449-b6d9a6b3e331 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.761026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e847-dec8-4f48-a449-b6d9a6b3e331 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.761525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e847-dec8-4f48-a449-b6d9a6b3e331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.773485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535e847-dec8-4f48-a449-b6d9a6b3e331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:39.776528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764bb3d-f9bc-4131-bd2b-52eddf0aca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:39.777254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bb3d-f9bc-4131-bd2b-52eddf0aca8e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.777536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bb3d-f9bc-4131-bd2b-52eddf0aca8e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.777812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bb3d-f9bc-4131-bd2b-52eddf0aca8e None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.778984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764bb3d-f9bc-4131-bd2b-52eddf0aca8e None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:39.780558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764bb3d-f9bc-4131-bd2b-52eddf0aca8e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-d535e847-dec8-4f48-a449-b6d9a6b3e331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:39.781273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:39.782156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:39.782954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:39.783681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 184/368] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:39.783681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764bb3d-f9bc-4131-bd2b-52eddf0aca8e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.785650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 185/369] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:39.791569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e847-dec8-4f48-a449-b6d9a6b3e331 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:39.876401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:39.939826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764bb3d-f9bc-4131-bd2b-52eddf0aca8e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.952326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e847-dec8-4f48-a449-b6d9a6b3e331 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:39.984140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:39.984684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:39.984965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:39.985240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:39.985958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:39.986313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:39.987753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:39.999080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 185/370] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:39.999981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:40.005550 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:40.006145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.006425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.006701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.008444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] RBAC: Adding query filter params (group.id=115dd9e888f042c8859af8a380571482, role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:40.008753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:40.010209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:40.019083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 186/371] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/role_assignments?group.id=115dd9e888f042c8859af8a380571482&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=cb911cef057e44fb9c8004a419568df8 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:40.022281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:40.073125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:40.187711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834566f-75c5-4393-8703-4ca8dfd17141 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:40.201841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e7de-1190-4fe1-af02-c7387256636a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:40.239291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:40.239887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.240165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.240437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.241158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:40.241530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:40.242938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:40.245225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:40.265375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 186/372] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:40.272066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:40.275625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca143d1-e9bb-4e5b-a9e2-692cc88be237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:40.276624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca143d1-e9bb-4e5b-a9e2-692cc88be237 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.277127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca143d1-e9bb-4e5b-a9e2-692cc88be237 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.277614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca143d1-e9bb-4e5b-a9e2-692cc88be237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.384083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca143d1-e9bb-4e5b-a9e2-692cc88be237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:40.387217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca143d1-e9bb-4e5b-a9e2-692cc88be237 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:40.425536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:40.432768 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322de0f3-4048-4c4d-bb61-b5bd742fd093 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:40.498970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baa7d8-1f4c-45ca-9018-fde8214fc7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:40.499763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baa7d8-1f4c-45ca-9018-fde8214fc7ca None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.500100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baa7d8-1f4c-45ca-9018-fde8214fc7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.500377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baa7d8-1f4c-45ca-9018-fde8214fc7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.540928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 187/373] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:40.546883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca143d1-e9bb-4e5b-a9e2-692cc88be237 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:40.569038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:40.587623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baa7d8-1f4c-45ca-9018-fde8214fc7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:40.589350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baa7d8-1f4c-45ca-9018-fde8214fc7ca None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:40.670289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca143d1-e9bb-4e5b-a9e2-692cc88be237 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:40.697982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:40.703554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 187/374] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:40.708845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baa7d8-1f4c-45ca-9018-fde8214fc7ca None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:40.721054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684553d3-4e5c-44f9-a096-3c80cb144a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:40.721804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684553d3-4e5c-44f9-a096-3c80cb144a0f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.722162 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684553d3-4e5c-44f9-a096-3c80cb144a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.722532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684553d3-4e5c-44f9-a096-3c80cb144a0f None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.724558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684553d3-4e5c-44f9-a096-3c80cb144a0f None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:40.726458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684553d3-4e5c-44f9-a096-3c80cb144a0f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:40.729347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 188/375] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:40 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:40.735533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684553d3-4e5c-44f9-a096-3c80cb144a0f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:40.847500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baa7d8-1f4c-45ca-9018-fde8214fc7ca None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:40.849650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:40.872422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684553d3-4e5c-44f9-a096-3c80cb144a0f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:40.895705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd364ba-12f1-436f-8855-433919a7b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:40.896841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd364ba-12f1-436f-8855-433919a7b84b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.897320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd364ba-12f1-436f-8855-433919a7b84b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.897966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd364ba-12f1-436f-8855-433919a7b84b None admin] PATH_INFO: `/v3/projects/ffae11e17dfb4f79b4af936d03276821` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.900530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd364ba-12f1-436f-8855-433919a7b84b None admin] RBAC: Authorizing `identity:get_project(project_id=ffae11e17dfb4f79b4af936d03276821)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:40.902356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd364ba-12f1-436f-8855-433919a7b84b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:40.904729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 188/376] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:40 2022] GET /identity/v3/projects/ffae11e17dfb4f79b4af936d03276821 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:40.906064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021821f3-029e-4786-9024-ec7775407fcd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.906426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021821f3-029e-4786-9024-ec7775407fcd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.906765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021821f3-029e-4786-9024-ec7775407fcd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.908689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 189/377] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:40.909748 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021821f3-029e-4786-9024-ec7775407fcd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:40.918476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6f489-ab76-4517-adb0-892e4da1ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:40.920039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f489-ab76-4517-adb0-892e4da1ccde None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.920523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f489-ab76-4517-adb0-892e4da1ccde None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.920982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f489-ab76-4517-adb0-892e4da1ccde None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.922834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6f489-ab76-4517-adb0-892e4da1ccde None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:40.925314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6f489-ab76-4517-adb0-892e4da1ccde None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:40.928324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 189/378] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:40 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:40.930315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4b34-e76b-41ee-8992-d97954f69983 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:40.930820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4b34-e76b-41ee-8992-d97954f69983 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:40.931304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4b34-e76b-41ee-8992-d97954f69983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:40.957417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f97d4b34-e76b-41ee-8992-d97954f69983 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:40.959249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f97d4b34-e76b-41ee-8992-d97954f69983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:40.998140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:41.055044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021821f3-029e-4786-9024-ec7775407fcd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:41.063889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 190/379] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:41.065706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d4b34-e76b-41ee-8992-d97954f69983 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:41.102977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744df94-87f0-4152-b4de-5c9b93e6a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:41.103601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744df94-87f0-4152-b4de-5c9b93e6a122 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:41.103879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744df94-87f0-4152-b4de-5c9b93e6a122 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:41.104155 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744df94-87f0-4152-b4de-5c9b93e6a122 None admin] PATH_INFO: `/v3/groups/f316f62fe48e44b09a095b81102f13b9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:41.113379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744df94-87f0-4152-b4de-5c9b93e6a122 None admin] RBAC: Authorizing `identity:get_group(group_id=f316f62fe48e44b09a095b81102f13b9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:41.114912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744df94-87f0-4152-b4de-5c9b93e6a122 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:41.117237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 190/380] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:40 2022] GET /identity/v3/groups/f316f62fe48e44b09a095b81102f13b9 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:41.117996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744df94-87f0-4152-b4de-5c9b93e6a122 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:41.180678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:41.202531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d4b34-e76b-41ee-8992-d97954f69983 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:41.241397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:41.241611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744df94-87f0-4152-b4de-5c9b93e6a122 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:41.242496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:41.242979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:41.243560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:41.244582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] RBAC: Adding query filter params (group.id=115dd9e888f042c8859af8a380571482, role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:41.245108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:41.246778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:41.255535 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 191/381] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:41 2022] GET /identity/v3/role_assignments?group.id=115dd9e888f042c8859af8a380571482&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:41.256600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:41.291861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:41.307504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66fee-bda7-4097-997a-8ac31313f42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:41.308565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66fee-bda7-4097-997a-8ac31313f42c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:41.308991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66fee-bda7-4097-997a-8ac31313f42c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:41.309432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66fee-bda7-4097-997a-8ac31313f42c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:41.330591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a66fee-bda7-4097-997a-8ac31313f42c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-46a66fee-bda7-4097-997a-8ac31313f42c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:41.341342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:41.342352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:41.343111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:41.345994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 191/382] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:41.352037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66fee-bda7-4097-997a-8ac31313f42c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:41.377146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ec67-5173-46e1-9cb1-0d2863c6e7d5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:41.415812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:41.416559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:41.416834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:41.417010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:41.417777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] RBAC: Adding query filter params (group.id=f316f62fe48e44b09a095b81102f13b9, role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=ffae11e17dfb4f79b4af936d03276821) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:41.418084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:41.419559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:41.425872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 192/383] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:41 2022] GET /identity/v3/role_assignments?group.id=f316f62fe48e44b09a095b81102f13b9&scope.project.id=ffae11e17dfb4f79b4af936d03276821&role.id=7a7079c0864e4bb7acaa71238097426e => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:41.521420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66fee-bda7-4097-997a-8ac31313f42c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:41.572596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:41.573647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:41.574149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:41.574632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:41.575828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:41.576359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:41.578057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:41.593724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 192/384] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:41.597081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:41.614930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:41.725354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00d92a-8581-4a8f-bb0e-5b46e06b49cf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:41.766068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9237-c887-4b76-9184-7b51094821d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:41.766726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9237-c887-4b76-9184-7b51094821d0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:41.767009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9237-c887-4b76-9184-7b51094821d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:41.767355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9237-c887-4b76-9184-7b51094821d0 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:41.768485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d9237-c887-4b76-9184-7b51094821d0 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:41.769947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d9237-c887-4b76-9184-7b51094821d0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:41.774412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 193/385] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:41 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:41.780339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:41.863152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:41.923701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff66e-fdc4-4f10-892d-c6bf05fa4ff1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:41.961545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf674-70e5-4c53-8a6a-7f73b6ba2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:41.962209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf674-70e5-4c53-8a6a-7f73b6ba2c53 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:41.962492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf674-70e5-4c53-8a6a-7f73b6ba2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:41.962773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf674-70e5-4c53-8a6a-7f73b6ba2c53 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:41.966931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf674-70e5-4c53-8a6a-7f73b6ba2c53 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:41.968568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf674-70e5-4c53-8a6a-7f73b6ba2c53 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:41.970286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 193/386] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:41 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:41.976434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9237-c887-4b76-9184-7b51094821d0 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:42.090925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:42.115627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9237-c887-4b76-9184-7b51094821d0 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:42.166864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67c180-b338-4289-999a-9c4568f4f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:42.166864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c180-b338-4289-999a-9c4568f4f3fc None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:42.166864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c180-b338-4289-999a-9c4568f4f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:42.167230 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c180-b338-4289-999a-9c4568f4f3fc None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093/groups/115dd9e888f042c8859af8a380571482/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:42.169187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67c180-b338-4289-999a-9c4568f4f3fc None admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e31d30c684107b874c500626aa093, group_id=115dd9e888f042c8859af8a380571482, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:42.170663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67c180-b338-4289-999a-9c4568f4f3fc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:42.189511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 194/387] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Aug 1 15:23:41 2022] PUT /identity/v3/projects/fc7e31d30c684107b874c500626aa093/groups/115dd9e888f042c8859af8a380571482/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:42.236436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341026ce-d00e-4d6f-8660-304b5370ef52 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:42.236641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341026ce-d00e-4d6f-8660-304b5370ef52 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:42.236902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341026ce-d00e-4d6f-8660-304b5370ef52 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:42.238286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 194/388] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:42.248523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8c2f-c8bf-484b-b891-bb0f949a5267 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:42.248810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8c2f-c8bf-484b-b891-bb0f949a5267 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:42.249092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8c2f-c8bf-484b-b891-bb0f949a5267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:42.272486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-280d8c2f-c8bf-484b-b891-bb0f949a5267 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:42.273795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-280d8c2f-c8bf-484b-b891-bb0f949a5267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:42.356510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 195/389] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:42.382621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341026ce-d00e-4d6f-8660-304b5370ef52 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:42.505178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341026ce-d00e-4d6f-8660-304b5370ef52 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:42.530213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:42.553283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff367df-8b71-4f27-b0da-05ea49ff3293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:42.554828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff367df-8b71-4f27-b0da-05ea49ff3293 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:42.555327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff367df-8b71-4f27-b0da-05ea49ff3293 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:42.555842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff367df-8b71-4f27-b0da-05ea49ff3293 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:42.570315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff367df-8b71-4f27-b0da-05ea49ff3293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6ff367df-8b71-4f27-b0da-05ea49ff3293 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:42.575655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:42.576559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:42.577329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 195/390] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:42.584585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8c2f-c8bf-484b-b891-bb0f949a5267 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:42.669757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:42.709780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8c2f-c8bf-484b-b891-bb0f949a5267 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:42.748321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:42.748955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:42.749246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:42.749520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:42.750247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:42.750560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:42.752091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:42.761168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 196/391] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:42.766746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff367df-8b71-4f27-b0da-05ea49ff3293 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:42.906592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff367df-8b71-4f27-b0da-05ea49ff3293 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:42.949052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170bcd-32a7-442a-8718-a8711bed95a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:42.949703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170bcd-32a7-442a-8718-a8711bed95a3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:42.949982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170bcd-32a7-442a-8718-a8711bed95a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:42.950255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170bcd-32a7-442a-8718-a8711bed95a3 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:42.951439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170bcd-32a7-442a-8718-a8711bed95a3 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:42.952890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170bcd-32a7-442a-8718-a8711bed95a3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:42.954905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 196/392] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:42 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:42.960902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:43.076603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195828d3-0438-4b89-bbae-37f99924e163 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:43.108290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:43.114693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eaac8-9264-4bb6-aeb7-e4f412196d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:43.115356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eaac8-9264-4bb6-aeb7-e4f412196d54 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:43.116949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eaac8-9264-4bb6-aeb7-e4f412196d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:43.117230 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eaac8-9264-4bb6-aeb7-e4f412196d54 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:43.118557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eaac8-9264-4bb6-aeb7-e4f412196d54 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:43.120059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eaac8-9264-4bb6-aeb7-e4f412196d54 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:43.122034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 197/393] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:42 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:43.128137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170bcd-32a7-442a-8718-a8711bed95a3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:43.161317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf92c4-ab7b-447a-aa9c-7d19413005af None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:43.161925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf92c4-ab7b-447a-aa9c-7d19413005af None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:43.162343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf92c4-ab7b-447a-aa9c-7d19413005af None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:43.165218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 198/394] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:43.177759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf98e7d-c8a5-40ca-a922-33b4a4003067 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:43.178254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf98e7d-c8a5-40ca-a922-33b4a4003067 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:43.178728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf98e7d-c8a5-40ca-a922-33b4a4003067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:43.197514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:43.213654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2cf98e7d-c8a5-40ca-a922-33b4a4003067 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:43.215282 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2cf98e7d-c8a5-40ca-a922-33b4a4003067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:43.269998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170bcd-32a7-442a-8718-a8711bed95a3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:43.321417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3555e-82ab-467e-82c3-befd4f58c5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:43.322099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3555e-82ab-467e-82c3-befd4f58c5da None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:43.322438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3555e-82ab-467e-82c3-befd4f58c5da None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:43.322891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3555e-82ab-467e-82c3-befd4f58c5da None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093/groups/115dd9e888f042c8859af8a380571482/roles/a3cb41ec3a524b60bc728cd4b0ab78e0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:43.325667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3555e-82ab-467e-82c3-befd4f58c5da None admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e31d30c684107b874c500626aa093, group_id=115dd9e888f042c8859af8a380571482, role_id=a3cb41ec3a524b60bc728cd4b0ab78e0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:43.327871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3555e-82ab-467e-82c3-befd4f58c5da None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:43.346296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 199/395] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:43.350376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 197/396] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Aug 1 15:23:43 2022] PUT /identity/v3/projects/fc7e31d30c684107b874c500626aa093/groups/115dd9e888f042c8859af8a380571482/roles/a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:23:43.368164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf98e7d-c8a5-40ca-a922-33b4a4003067 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:43.501470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf98e7d-c8a5-40ca-a922-33b4a4003067 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:43.544632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:43.556126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fff0c-3295-49d6-8728-e373f1dc323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:43.557070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fff0c-3295-49d6-8728-e373f1dc323f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:43.557495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fff0c-3295-49d6-8728-e373f1dc323f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:43.557910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fff0c-3295-49d6-8728-e373f1dc323f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:43.572584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fff0c-3295-49d6-8728-e373f1dc323f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f08fff0c-3295-49d6-8728-e373f1dc323f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:43.578319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:43.579448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:43.580433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:43.583066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 200/397] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:43.589347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3555e-82ab-467e-82c3-befd4f58c5da None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:43.743307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3555e-82ab-467e-82c3-befd4f58c5da None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:43.752994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:43.792157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:43.792799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:43.793084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:43.793361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:43.794086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:43.794406 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:43.795892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:43.808739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 198/398] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:43.814466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fff0c-3295-49d6-8728-e373f1dc323f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:43.961018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fff0c-3295-49d6-8728-e373f1dc323f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:44.003096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2bb17-005a-47fe-b585-041099c50ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:44.003787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bb17-005a-47fe-b585-041099c50ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.004074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bb17-005a-47fe-b585-041099c50ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.004350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bb17-005a-47fe-b585-041099c50ef9 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.005528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2bb17-005a-47fe-b585-041099c50ef9 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:44.007571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2bb17-005a-47fe-b585-041099c50ef9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:44.009763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 201/399] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:43 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:44.015185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:44.127422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99622be9-cda7-458c-8860-9eb654e33fe0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:44.159404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74077426-5765-40d2-b066-a3ab3d1ff066 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.159929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74077426-5765-40d2-b066-a3ab3d1ff066 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.160577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74077426-5765-40d2-b066-a3ab3d1ff066 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.167831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 202/400] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:44.175271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79856a4-4e43-402b-a06f-7d94607056d1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.176237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79856a4-4e43-402b-a06f-7d94607056d1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.176734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79856a4-4e43-402b-a06f-7d94607056d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.202704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59ac0c-400f-44c6-acee-6a00f929176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:44.205013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59ac0c-400f-44c6-acee-6a00f929176e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.206057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59ac0c-400f-44c6-acee-6a00f929176e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.207726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59ac0c-400f-44c6-acee-6a00f929176e None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.209568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59ac0c-400f-44c6-acee-6a00f929176e None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:44.210515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c79856a4-4e43-402b-a06f-7d94607056d1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:44.212926 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c79856a4-4e43-402b-a06f-7d94607056d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:44.213944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59ac0c-400f-44c6-acee-6a00f929176e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:44.216552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 199/401] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:44 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:44.221877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59ac0c-400f-44c6-acee-6a00f929176e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:44.270513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:44.337926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59ac0c-400f-44c6-acee-6a00f929176e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:44.354341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:44.380393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21273d51-a6d6-45ab-9930-d3c89ecb3082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:44.380739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273d51-a6d6-45ab-9930-d3c89ecb3082 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.382615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273d51-a6d6-45ab-9930-d3c89ecb3082 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.382615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273d51-a6d6-45ab-9930-d3c89ecb3082 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/groups/115dd9e888f042c8859af8a380571482/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.385034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21273d51-a6d6-45ab-9930-d3c89ecb3082 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5, group_id=115dd9e888f042c8859af8a380571482, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:44.388446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21273d51-a6d6-45ab-9930-d3c89ecb3082 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:44.390149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 203/402] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:44.391443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c560f-1081-478d-9b9c-4b75ac471c0d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.391841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c560f-1081-478d-9b9c-4b75ac471c0d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.392217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c560f-1081-478d-9b9c-4b75ac471c0d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.397566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 204/403] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:44.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cec4d-f099-46ed-9508-629f29dd25fd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.399206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cec4d-f099-46ed-9508-629f29dd25fd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.399623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cec4d-f099-46ed-9508-629f29dd25fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.419474 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 200/404] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Aug 1 15:23:44 2022] PUT /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/groups/115dd9e888f042c8859af8a380571482/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:44.419932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f89cec4d-f099-46ed-9508-629f29dd25fd None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:44.421510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f89cec4d-f099-46ed-9508-629f29dd25fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:44.432741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21273d51-a6d6-45ab-9930-d3c89ecb3082 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:44.555018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 205/405] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:44.599903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cec4d-f099-46ed-9508-629f29dd25fd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:44.622154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:44.624764 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21273d51-a6d6-45ab-9930-d3c89ecb3082 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:44.673655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7997b1-4ede-4e39-a850-7cd69425e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:44.674313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7997b1-4ede-4e39-a850-7cd69425e64a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.674600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7997b1-4ede-4e39-a850-7cd69425e64a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.674878 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7997b1-4ede-4e39-a850-7cd69425e64a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.688912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7997b1-4ede-4e39-a850-7cd69425e64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-da7997b1-4ede-4e39-a850-7cd69425e64a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:44.695631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:44.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:44.697293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 201/406] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:44.703064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7997b1-4ede-4e39-a850-7cd69425e64a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:44.730373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cec4d-f099-46ed-9508-629f29dd25fd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:44.751866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:44.790726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37cec-05bf-4810-871d-c48e8756faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:44.791407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37cec-05bf-4810-871d-c48e8756faf6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.791696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37cec-05bf-4810-871d-c48e8756faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.791971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37cec-05bf-4810-871d-c48e8756faf6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.809627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac37cec-05bf-4810-871d-c48e8756faf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-dac37cec-05bf-4810-871d-c48e8756faf6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:44.817502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:44.818799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:44.820129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 206/407] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:44.825181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37cec-05bf-4810-871d-c48e8756faf6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:44.886804 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7997b1-4ede-4e39-a850-7cd69425e64a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:44.954339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:44.954982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:44.955267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:44.955574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:44.956313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:44.956621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:44.958060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:44.980063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 202/408] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:44.983744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:45.018183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37cec-05bf-4810-871d-c48e8756faf6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.027743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.089917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e140a7-b2f5-4e00-8b5c-e660c08ebc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:45.090467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e140a7-b2f5-4e00-8b5c-e660c08ebc9c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.090750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e140a7-b2f5-4e00-8b5c-e660c08ebc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.091025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e140a7-b2f5-4e00-8b5c-e660c08ebc9c None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.091789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e140a7-b2f5-4e00-8b5c-e660c08ebc9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:45.092100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e140a7-b2f5-4e00-8b5c-e660c08ebc9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:45.094513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e140a7-b2f5-4e00-8b5c-e660c08ebc9c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:45.111836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 207/409] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:45.113438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533730e3-6ef7-442d-829f-028b39900c94 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.113730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533730e3-6ef7-442d-829f-028b39900c94 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.114009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533730e3-6ef7-442d-829f-028b39900c94 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.115873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 208/410] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:45.120476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533730e3-6ef7-442d-829f-028b39900c94 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:45.145351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730aef-89f5-4194-92c8-f89870457e14 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.174118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.184543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006f42a-64bb-46cd-8634-2e21f5a61b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:45.185508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f42a-64bb-46cd-8634-2e21f5a61b4f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.185992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f42a-64bb-46cd-8634-2e21f5a61b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.186461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f42a-64bb-46cd-8634-2e21f5a61b4f None admin] PATH_INFO: `/v3/groups/f316f62fe48e44b09a095b81102f13b9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.187901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006f42a-64bb-46cd-8634-2e21f5a61b4f None admin] RBAC: Authorizing `identity:get_group(group_id=f316f62fe48e44b09a095b81102f13b9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:45.189615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006f42a-64bb-46cd-8634-2e21f5a61b4f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:45.196597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 203/411] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:44 2022] GET /identity/v3/groups/f316f62fe48e44b09a095b81102f13b9 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:45.198175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523dff2-be76-4466-907e-cf80830ede3a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.198541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523dff2-be76-4466-907e-cf80830ede3a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.198896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523dff2-be76-4466-907e-cf80830ede3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.225647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a523dff2-be76-4466-907e-cf80830ede3a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:45.227295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a523dff2-be76-4466-907e-cf80830ede3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:45.244538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533730e3-6ef7-442d-829f-028b39900c94 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.284976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdb962-f549-4b48-ad0d-0a76d39b49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:45.285790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdb962-f549-4b48-ad0d-0a76d39b49e3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.286139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdb962-f549-4b48-ad0d-0a76d39b49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.286522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdb962-f549-4b48-ad0d-0a76d39b49e3 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.287801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdb962-f549-4b48-ad0d-0a76d39b49e3 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:45.289393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdb962-f549-4b48-ad0d-0a76d39b49e3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:45.291755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 209/412] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:45 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:45.292659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdb962-f549-4b48-ad0d-0a76d39b49e3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:45.312864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 204/413] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:45.313818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523dff2-be76-4466-907e-cf80830ede3a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:45.336096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.438120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdb962-f549-4b48-ad0d-0a76d39b49e3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.446861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523dff2-be76-4466-907e-cf80830ede3a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.448124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.479461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25056f3-ff2c-4ede-b3a5-0135cfd7cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:45.480173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25056f3-ff2c-4ede-b3a5-0135cfd7cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.480451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25056f3-ff2c-4ede-b3a5-0135cfd7cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.480723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25056f3-ff2c-4ede-b3a5-0135cfd7cbd9 None admin] PATH_INFO: `/v3/projects/ffae11e17dfb4f79b4af936d03276821` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.481929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25056f3-ff2c-4ede-b3a5-0135cfd7cbd9 None admin] RBAC: Authorizing `identity:get_project(project_id=ffae11e17dfb4f79b4af936d03276821)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:45.483396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25056f3-ff2c-4ede-b3a5-0135cfd7cbd9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:45.489876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 210/414] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:45 2022] GET /identity/v3/projects/ffae11e17dfb4f79b4af936d03276821 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:45.489876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25056f3-ff2c-4ede-b3a5-0135cfd7cbd9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:45.504673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a4f5-2696-4b9d-993e-a2538cf80779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:45.505883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a4f5-2696-4b9d-993e-a2538cf80779 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.506616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a4f5-2696-4b9d-993e-a2538cf80779 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.507678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a4f5-2696-4b9d-993e-a2538cf80779 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.509425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871a4f5-2696-4b9d-993e-a2538cf80779 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:45.511938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871a4f5-2696-4b9d-993e-a2538cf80779 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:45.514412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 205/415] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:45 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:45.515894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a4f5-2696-4b9d-993e-a2538cf80779 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:45.600152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25056f3-ff2c-4ede-b3a5-0135cfd7cbd9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.630879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.649572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a4f5-2696-4b9d-993e-a2538cf80779 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.653207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4ff8b-0640-4611-8165-90907d22204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:45.654063 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ff8b-0640-4611-8165-90907d22204a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.654540 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ff8b-0640-4611-8165-90907d22204a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.655005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ff8b-0640-4611-8165-90907d22204a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.671967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4ff8b-0640-4611-8165-90907d22204a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-fbd4ff8b-0640-4611-8165-90907d22204a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:45.677714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:45.678602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:45.679440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:45.683710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 211/416] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:45.684549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4ff8b-0640-4611-8165-90907d22204a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:45.702359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322266-a5bb-42fe-afae-0812311de337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:45.703988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322266-a5bb-42fe-afae-0812311de337 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.704732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322266-a5bb-42fe-afae-0812311de337 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.705219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322266-a5bb-42fe-afae-0812311de337 None admin] PATH_INFO: `/v3/projects/ffae11e17dfb4f79b4af936d03276821/groups/f316f62fe48e44b09a095b81102f13b9/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.707907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c322266-a5bb-42fe-afae-0812311de337 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffae11e17dfb4f79b4af936d03276821, group_id=f316f62fe48e44b09a095b81102f13b9, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:45.709814 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c322266-a5bb-42fe-afae-0812311de337 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:45.727848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.733988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 206/417] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Aug 1 15:23:45 2022] PUT /identity/v3/projects/ffae11e17dfb4f79b4af936d03276821/groups/f316f62fe48e44b09a095b81102f13b9/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:45.733988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322266-a5bb-42fe-afae-0812311de337 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:45.877665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4ff8b-0640-4611-8165-90907d22204a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.928005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6268b-9dda-42be-9543-a52c89181107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:45.929603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6268b-9dda-42be-9543-a52c89181107 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.930103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6268b-9dda-42be-9543-a52c89181107 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.930591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6268b-9dda-42be-9543-a52c89181107 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/groups/115dd9e888f042c8859af8a380571482/roles/a3cb41ec3a524b60bc728cd4b0ab78e0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.934081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6268b-9dda-42be-9543-a52c89181107 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5, group_id=115dd9e888f042c8859af8a380571482, role_id=a3cb41ec3a524b60bc728cd4b0ab78e0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:45.936393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6268b-9dda-42be-9543-a52c89181107 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:45.955904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 212/418] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Aug 1 15:23:45 2022] PUT /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5/groups/115dd9e888f042c8859af8a380571482/roles/a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:23:45.967296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322266-a5bb-42fe-afae-0812311de337 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:45.976393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825f324-cf4f-4298-8595-e55ed63a2729 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.977330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825f324-cf4f-4298-8595-e55ed63a2729 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.977980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825f324-cf4f-4298-8595-e55ed63a2729 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:45.980188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 213/419] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:45.986882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6484ce-aa8a-43af-9bfa-8cac40b502af None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:45.987338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6484ce-aa8a-43af-9bfa-8cac40b502af None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:45.987654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6484ce-aa8a-43af-9bfa-8cac40b502af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.011083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-fb6484ce-aa8a-43af-9bfa-8cac40b502af None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:46.012674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fb6484ce-aa8a-43af-9bfa-8cac40b502af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:46.028643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:46.029545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.029827 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.030150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.031426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:46.031426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:46.032852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:46.043098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 207/420] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:46.052639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:46.066560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.110403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 214/421] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:46.141438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6484ce-aa8a-43af-9bfa-8cac40b502af None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:46.182484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.222199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67435cb-09a7-47b2-9840-f6fb944948f6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:46.271119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188014-adeb-4c98-bf0c-896855952549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:46.272574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188014-adeb-4c98-bf0c-896855952549 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.272968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188014-adeb-4c98-bf0c-896855952549 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.273354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188014-adeb-4c98-bf0c-896855952549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.287079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6484ce-aa8a-43af-9bfa-8cac40b502af None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:46.329248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b7d6-ec0a-4f26-9234-9c5596e4628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:46.330315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b7d6-ec0a-4f26-9234-9c5596e4628d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.330873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b7d6-ec0a-4f26-9234-9c5596e4628d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.331392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b7d6-ec0a-4f26-9234-9c5596e4628d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.343431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502b7d6-ec0a-4f26-9234-9c5596e4628d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6502b7d6-ec0a-4f26-9234-9c5596e4628d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:46.353068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:46.354842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:46.356460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:46.360844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 215/422] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:46.367571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1188014-adeb-4c98-bf0c-896855952549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:46.367722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b7d6-ec0a-4f26-9234-9c5596e4628d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:46.369069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1188014-adeb-4c98-bf0c-896855952549 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:46.381363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.504009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 208/423] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:46.510666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188014-adeb-4c98-bf0c-896855952549 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:46.557706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.589023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b7d6-ec0a-4f26-9234-9c5596e4628d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:46.636830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:46.637463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.637752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.638030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.638750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:46.639057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:46.640541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:46.655514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 216/424] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:46.661498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:46.737644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188014-adeb-4c98-bf0c-896855952549 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:46.757220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.779770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce2248-4f02-4ce1-bf08-a7b6666e7e25 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:46.791852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37242177-486b-4bec-ba5b-b78ba7428085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:46.792803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242177-486b-4bec-ba5b-b78ba7428085 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.793153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242177-486b-4bec-ba5b-b78ba7428085 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.793552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242177-486b-4bec-ba5b-b78ba7428085 None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.794822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37242177-486b-4bec-ba5b-b78ba7428085 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:46.796566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37242177-486b-4bec-ba5b-b78ba7428085 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:46.798652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 209/425] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:46 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:46.804435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f288a-dcbd-465a-95e5-1fd61f8711fa None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.804799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f288a-dcbd-465a-95e5-1fd61f8711fa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.805142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f288a-dcbd-465a-95e5-1fd61f8711fa None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.806884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 210/426] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:46.807711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f288a-dcbd-465a-95e5-1fd61f8711fa None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:46.817860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aecd4e-1ce9-47e4-946f-d53b1b98f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:46.818628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aecd4e-1ce9-47e4-946f-d53b1b98f2ad None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.818917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aecd4e-1ce9-47e4-946f-d53b1b98f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.819198 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aecd4e-1ce9-47e4-946f-d53b1b98f2ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.837555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.900870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aecd4e-1ce9-47e4-946f-d53b1b98f2ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:46.902535 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aecd4e-1ce9-47e4-946f-d53b1b98f2ad None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:46.950028 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f288a-dcbd-465a-95e5-1fd61f8711fa None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:46.986820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b56abe-5a66-4d9c-b09a-d151c2fccfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:46.987517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56abe-5a66-4d9c-b09a-d151c2fccfda None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.987794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56abe-5a66-4d9c-b09a-d151c2fccfda None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.988077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56abe-5a66-4d9c-b09a-d151c2fccfda None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:46.989261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b56abe-5a66-4d9c-b09a-d151c2fccfda None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:46.990717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b56abe-5a66-4d9c-b09a-d151c2fccfda None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:46.993193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 211/427] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:46 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:46.994401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8a09-b9a9-4e5e-9092-25189c9f1a36 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:46.994692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8a09-b9a9-4e5e-9092-25189c9f1a36 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:46.994970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8a09-b9a9-4e5e-9092-25189c9f1a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:47.014994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f5bd8a09-b9a9-4e5e-9092-25189c9f1a36 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:47.016232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f5bd8a09-b9a9-4e5e-9092-25189c9f1a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:47.037176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 217/428] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:47.038870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aecd4e-1ce9-47e4-946f-d53b1b98f2ad None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:47.066528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:47.096707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 212/429] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:47.097651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd8a09-b9a9-4e5e-9092-25189c9f1a36 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:47.104181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:47.185123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aecd4e-1ce9-47e4-946f-d53b1b98f2ad None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:47.228061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:47.228839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:47.229067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:47.229351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:47.230146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] RBAC: Adding query filter params (group.id=115dd9e888f042c8859af8a380571482, role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=fc7e31d30c684107b874c500626aa093) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:47.230466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:47.232024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:47.232981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd8a09-b9a9-4e5e-9092-25189c9f1a36 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:47.239367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 218/430] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:47 2022] GET /identity/v3/role_assignments?group.id=115dd9e888f042c8859af8a380571482&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=cb911cef057e44fb9c8004a419568df8 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:47.240042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:47.275512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fea3b0-8d83-4f9b-8726-b441ee4ec11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:47.276525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fea3b0-8d83-4f9b-8726-b441ee4ec11a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:47.277032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fea3b0-8d83-4f9b-8726-b441ee4ec11a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:47.277518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fea3b0-8d83-4f9b-8726-b441ee4ec11a None admin] PATH_INFO: `/v3/projects/fc7e31d30c684107b874c500626aa093` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:47.279131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fea3b0-8d83-4f9b-8726-b441ee4ec11a None admin] RBAC: Authorizing `identity:get_project(project_id=fc7e31d30c684107b874c500626aa093)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:47.280957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fea3b0-8d83-4f9b-8726-b441ee4ec11a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:47.283097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 213/431] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:47 2022] GET /identity/v3/projects/fc7e31d30c684107b874c500626aa093 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:47.292493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fea3b0-8d83-4f9b-8726-b441ee4ec11a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:47.371678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd787c-0332-4f23-a305-2de4d851ec85 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:47.375460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:47.387004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:47.421948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872527dd-0be5-4963-97e5-488fafeee5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:47.424071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872527dd-0be5-4963-97e5-488fafeee5fa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:47.424721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872527dd-0be5-4963-97e5-488fafeee5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:47.426742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872527dd-0be5-4963-97e5-488fafeee5fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:47.446389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872527dd-0be5-4963-97e5-488fafeee5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-872527dd-0be5-4963-97e5-488fafeee5fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:47.453172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:47.454318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:23:47.455250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:47.457497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 219/432] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:47.464442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872527dd-0be5-4963-97e5-488fafeee5fa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:47.512332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fea3b0-8d83-4f9b-8726-b441ee4ec11a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:47.557504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f11d-2ae1-450a-8fe9-39a3c6d0a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:47.558719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f11d-2ae1-450a-8fe9-39a3c6d0a610 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:47.559185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f11d-2ae1-450a-8fe9-39a3c6d0a610 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:47.559587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f11d-2ae1-450a-8fe9-39a3c6d0a610 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:47.560937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87f11d-2ae1-450a-8fe9-39a3c6d0a610 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:47.562541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87f11d-2ae1-450a-8fe9-39a3c6d0a610 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:47.566115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 214/433] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:47 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:47.573688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f11d-2ae1-450a-8fe9-39a3c6d0a610 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:47.630510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872527dd-0be5-4963-97e5-488fafeee5fa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:47.676218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:47.677232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:47.677667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:47.678116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:47.679274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:47.679748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:47.681301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:47.693678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 220/434] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:23:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:47.696010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f11d-2ae1-450a-8fe9-39a3c6d0a610 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:47.699221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:47.712137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:47.741033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:47.742310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:47.742673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:47.743017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:47.743829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:47.743936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] RBAC: Adding query filter params (group.id=115dd9e888f042c8859af8a380571482, role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=fc7e31d30c684107b874c500626aa093) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:47.744342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:47.746306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:47.758000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 215/435] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:47 2022] GET /identity/v3/role_assignments?group.id=115dd9e888f042c8859af8a380571482&scope.project.id=fc7e31d30c684107b874c500626aa093&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:47.855281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430cc9-cfc9-4f26-90c3-75fb9a9d47dc None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:47.907750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84862fdb-9ff8-48b6-b820-ce54a2fa2e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:47.908445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84862fdb-9ff8-48b6-b820-ce54a2fa2e63 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:47.908677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84862fdb-9ff8-48b6-b820-ce54a2fa2e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:47.908948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84862fdb-9ff8-48b6-b820-ce54a2fa2e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:47.993035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84862fdb-9ff8-48b6-b820-ce54a2fa2e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:47.994493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84862fdb-9ff8-48b6-b820-ce54a2fa2e63 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:48.028004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:48.112126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 221/436] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:48.117525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:48.237638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fbe2f-9163-4545-860b-f2d049fba82c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:48.285226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22524e8c-38d9-47b8-b39e-32cc0f6a5001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:48.285928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22524e8c-38d9-47b8-b39e-32cc0f6a5001 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.286168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22524e8c-38d9-47b8-b39e-32cc0f6a5001 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.286451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22524e8c-38d9-47b8-b39e-32cc0f6a5001 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.287695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22524e8c-38d9-47b8-b39e-32cc0f6a5001 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:48.289287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22524e8c-38d9-47b8-b39e-32cc0f6a5001 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:48.295448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 216/437] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:48 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:48.297189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84862fdb-9ff8-48b6-b820-ce54a2fa2e63 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:48.313086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492a221-8571-43c7-aea2-f938176bff39 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.313693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492a221-8571-43c7-aea2-f938176bff39 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.314130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492a221-8571-43c7-aea2-f938176bff39 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.316525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 217/438] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:23:48.323081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f3981-aa51-4e38-8f0f-bc77c459b74b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.323404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f3981-aa51-4e38-8f0f-bc77c459b74b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.323674 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f3981-aa51-4e38-8f0f-bc77c459b74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.344283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a48f3981-aa51-4e38-8f0f-bc77c459b74b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:48.345496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a48f3981-aa51-4e38-8f0f-bc77c459b74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:48.402780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:48.439020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 218/439] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:48.440407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d4943-ff9f-4852-8cef-5b56fb160dcd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.440654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d4943-ff9f-4852-8cef-5b56fb160dcd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.440937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d4943-ff9f-4852-8cef-5b56fb160dcd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.442219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 219/440] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:48.449580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56712-06e4-46bb-ace3-c7c26aa6c9a2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.449859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56712-06e4-46bb-ace3-c7c26aa6c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.450131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56712-06e4-46bb-ace3-c7c26aa6c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.460904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84862fdb-9ff8-48b6-b820-ce54a2fa2e63 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:48.469089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-95f56712-06e4-46bb-ace3-c7c26aa6c9a2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:48.470283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-95f56712-06e4-46bb-ace3-c7c26aa6c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:48.497921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:48.504063 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248248-e26f-4585-b665-575d56639569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:48.504715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248248-e26f-4585-b665-575d56639569 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.505002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248248-e26f-4585-b665-575d56639569 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.505272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248248-e26f-4585-b665-575d56639569 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.506424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0248248-e26f-4585-b665-575d56639569 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:48.508478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0248248-e26f-4585-b665-575d56639569 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:48.510085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 222/441] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:48 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:48.510859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248248-e26f-4585-b665-575d56639569 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:48.554516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 220/442] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:48.558665 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f56712-06e4-46bb-ace3-c7c26aa6c9a2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:48.634140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248248-e26f-4585-b665-575d56639569 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:48.674276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f56712-06e4-46bb-ace3-c7c26aa6c9a2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:48.676385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:48.677192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf29bf-1034-4b02-ad83-78744b1a3144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:48.677851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf29bf-1034-4b02-ad83-78744b1a3144 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.678130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf29bf-1034-4b02-ad83-78744b1a3144 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.678580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf29bf-1034-4b02-ad83-78744b1a3144 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.691263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf29bf-1034-4b02-ad83-78744b1a3144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6bdf29bf-1034-4b02-ad83-78744b1a3144 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:48.698503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:48.699848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 223/443] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:48.701265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf29bf-1034-4b02-ad83-78744b1a3144 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:48.719843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:48.720331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.720614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.720888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.721673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] RBAC: Adding query filter params (group.id=115dd9e888f042c8859af8a380571482, role.id=cb911cef057e44fb9c8004a419568df8, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:48.721981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:48.723434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:48.730286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 221/444] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:48 2022] GET /identity/v3/role_assignments?group.id=115dd9e888f042c8859af8a380571482&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=cb911cef057e44fb9c8004a419568df8 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:48.731096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:48.782616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:48.849106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf29bf-1034-4b02-ad83-78744b1a3144 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:48.879345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cef50-57e3-4c82-a319-d2c1b9f0d336 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:48.900333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840607e-4e58-4840-8039-180f80f73dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:48.900618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840607e-4e58-4840-8039-180f80f73dff None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.900751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840607e-4e58-4840-8039-180f80f73dff None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.901062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840607e-4e58-4840-8039-180f80f73dff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.917634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840607e-4e58-4840-8039-180f80f73dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3840607e-4e58-4840-8039-180f80f73dff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:48.923287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:48.924193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:48.925350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 224/445] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:48.931048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:48.931714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:48.931996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:48.932268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:48.932366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840607e-4e58-4840-8039-180f80f73dff None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:48.932991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:48.933291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:48.934677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:48.944149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 222/446] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:48.950640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:48.986132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:49.048634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840607e-4e58-4840-8039-180f80f73dff None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.070673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:49.077423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd190e-9c42-4dab-ab7d-bc3151966bcd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.089205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.090120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.090403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.090680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.091471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:49.091786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.093193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.105784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 225/447] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:49.111529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:49.119840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eb46d-abaa-48bf-b2d8-58fad88e46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.120468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eb46d-abaa-48bf-b2d8-58fad88e46c4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.121100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eb46d-abaa-48bf-b2d8-58fad88e46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.121100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eb46d-abaa-48bf-b2d8-58fad88e46c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.189430 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624eb46d-abaa-48bf-b2d8-58fad88e46c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.190799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624eb46d-abaa-48bf-b2d8-58fad88e46c4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.213374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209c47d-d912-4eed-818a-f2fab237058f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.218756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:49.251533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ef0df-ae5d-4710-a519-b15aae6aa2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.252255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ef0df-ae5d-4710-a519-b15aae6aa2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.252836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ef0df-ae5d-4710-a519-b15aae6aa2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.252836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ef0df-ae5d-4710-a519-b15aae6aa2e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.298297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 223/448] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:49.304241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eb46d-abaa-48bf-b2d8-58fad88e46c4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:49.309150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:49.330396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ef0df-ae5d-4710-a519-b15aae6aa2e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.332048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ef0df-ae5d-4710-a519-b15aae6aa2e1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.411187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eb46d-abaa-48bf-b2d8-58fad88e46c4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.435638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 226/449] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:49.437725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:49.441513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ef0df-ae5d-4710-a519-b15aae6aa2e1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:49.446874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2767b-89cd-42a9-9138-6f225f3cdebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.447551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2767b-89cd-42a9-9138-6f225f3cdebc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.447833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2767b-89cd-42a9-9138-6f225f3cdebc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.448103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2767b-89cd-42a9-9138-6f225f3cdebc None admin] PATH_INFO: `/v3/projects/ffae11e17dfb4f79b4af936d03276821` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.449252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2767b-89cd-42a9-9138-6f225f3cdebc None admin] RBAC: Authorizing `identity:get_project(project_id=ffae11e17dfb4f79b4af936d03276821)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.450823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2767b-89cd-42a9-9138-6f225f3cdebc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.452499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 224/450] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:49 2022] GET /identity/v3/projects/ffae11e17dfb4f79b4af936d03276821 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:49.457973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2767b-89cd-42a9-9138-6f225f3cdebc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:49.523187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:49.542055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ef0df-ae5d-4710-a519-b15aae6aa2e1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.558221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2767b-89cd-42a9-9138-6f225f3cdebc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.578068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600fd3-456a-4673-bbf8-b1b9e4f175a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.578751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600fd3-456a-4673-bbf8-b1b9e4f175a6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.579000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600fd3-456a-4673-bbf8-b1b9e4f175a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.579267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600fd3-456a-4673-bbf8-b1b9e4f175a6 None admin] PATH_INFO: `/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.580451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f600fd3-456a-4673-bbf8-b1b9e4f175a6 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f641a8f8144fc9e62f1bdf9f236f5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.581903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f600fd3-456a-4673-bbf8-b1b9e4f175a6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.583574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 227/451] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:23:49 2022] GET /identity/v3/projects/dd6f641a8f8144fc9e62f1bdf9f236f5 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:49.591005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600fd3-456a-4673-bbf8-b1b9e4f175a6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:49.594231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e57db9-e2e2-430b-a464-a5188953b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.594816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e57db9-e2e2-430b-a464-a5188953b20c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.594816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e57db9-e2e2-430b-a464-a5188953b20c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.594816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e57db9-e2e2-430b-a464-a5188953b20c None admin] PATH_INFO: `/v3/groups/f316f62fe48e44b09a095b81102f13b9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.595983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e57db9-e2e2-430b-a464-a5188953b20c None admin] RBAC: Authorizing `identity:get_group(group_id=f316f62fe48e44b09a095b81102f13b9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.597444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e57db9-e2e2-430b-a464-a5188953b20c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.599039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 225/452] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:49 2022] GET /identity/v3/groups/f316f62fe48e44b09a095b81102f13b9 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:49.605270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e57db9-e2e2-430b-a464-a5188953b20c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:49.674406 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:49.700380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600fd3-456a-4673-bbf8-b1b9e4f175a6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.714123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e57db9-e2e2-430b-a464-a5188953b20c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.734690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9260da-3379-4fc5-ac28-e1caab61d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.735320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9260da-3379-4fc5-ac28-e1caab61d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.735638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9260da-3379-4fc5-ac28-e1caab61d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.735917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9260da-3379-4fc5-ac28-e1caab61d3e2 None admin] PATH_INFO: `/v3/groups/115dd9e888f042c8859af8a380571482` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.737072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9260da-3379-4fc5-ac28-e1caab61d3e2 None admin] RBAC: Authorizing `identity:get_group(group_id=115dd9e888f042c8859af8a380571482)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.738517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9260da-3379-4fc5-ac28-e1caab61d3e2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.740142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 228/453] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Aug 1 15:23:49 2022] GET /identity/v3/groups/115dd9e888f042c8859af8a380571482 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:49.746632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9260da-3379-4fc5-ac28-e1caab61d3e2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:49.749923 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c4c60-98c8-4fbc-8ac0-4ff94ed6ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.750545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c4c60-98c8-4fbc-8ac0-4ff94ed6ea7c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.750921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c4c60-98c8-4fbc-8ac0-4ff94ed6ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.751195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c4c60-98c8-4fbc-8ac0-4ff94ed6ea7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.752125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c4c60-98c8-4fbc-8ac0-4ff94ed6ea7c None admin] RBAC: Adding query filter params (group.id=f316f62fe48e44b09a095b81102f13b9, role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=ffae11e17dfb4f79b4af936d03276821) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:49.752422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c4c60-98c8-4fbc-8ac0-4ff94ed6ea7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.754004 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c4c60-98c8-4fbc-8ac0-4ff94ed6ea7c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.760374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 226/454] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:49 2022] GET /identity/v3/role_assignments?group.id=f316f62fe48e44b09a095b81102f13b9&scope.project.id=ffae11e17dfb4f79b4af936d03276821&role.id=7a7079c0864e4bb7acaa71238097426e => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:49.770445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:49.860888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9260da-3379-4fc5-ac28-e1caab61d3e2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:49.897227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8b2f1-23b8-4791-9103-8979d6b96383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:49.897889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b2f1-23b8-4791-9103-8979d6b96383 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:49.898168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b2f1-23b8-4791-9103-8979d6b96383 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:49.898441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b2f1-23b8-4791-9103-8979d6b96383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:49.899244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8b2f1-23b8-4791-9103-8979d6b96383 None admin] RBAC: Adding query filter params (group.id=115dd9e888f042c8859af8a380571482, role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:49.899590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8b2f1-23b8-4791-9103-8979d6b96383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:49.901051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8b2f1-23b8-4791-9103-8979d6b96383 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:49.907407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 229/455] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Aug 1 15:23:49 2022] GET /identity/v3/role_assignments?group.id=115dd9e888f042c8859af8a380571482&scope.project.id=dd6f641a8f8144fc9e62f1bdf9f236f5&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:52.470035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff50f-d78e-45cb-aa78-695cc019d9ab None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:52.470678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff50f-d78e-45cb-aa78-695cc019d9ab None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:52.470678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff50f-d78e-45cb-aa78-695cc019d9ab None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:52.472792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 227/456] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:52.477800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a126-99f1-4f08-a996-41a4bacfbb47 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:52.478634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a126-99f1-4f08-a996-41a4bacfbb47 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:52.479109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a126-99f1-4f08-a996-41a4bacfbb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:52.508464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4018a126-99f1-4f08-a996-41a4bacfbb47 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:52.509975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4018a126-99f1-4f08-a996-41a4bacfbb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:52.604100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 230/457] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:52.622986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3ab4-791a-414b-a400-69b6f45d1e7c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:52.623631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3ab4-791a-414b-a400-69b6f45d1e7c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:52.624148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3ab4-791a-414b-a400-69b6f45d1e7c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:52.625947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 228/458] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:52.630925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc33473-bd5c-477b-8620-966ee12d3a25 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:52.631211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc33473-bd5c-477b-8620-966ee12d3a25 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:52.631522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc33473-bd5c-477b-8620-966ee12d3a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:52.633769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea3ab4-791a-414b-a400-69b6f45d1e7c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:52.651266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8fc33473-bd5c-477b-8620-966ee12d3a25 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:52.652582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8fc33473-bd5c-477b-8620-966ee12d3a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:52.707788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:52.734275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 231/459] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:52.764347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc33473-bd5c-477b-8620-966ee12d3a25 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:52.793308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea3ab4-791a-414b-a400-69b6f45d1e7c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:52.828329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:52.833026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:52.833688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:52.833973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:52.834249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:52.856876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:52.858366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:52.887017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:52.887954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:52.888855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:52.888855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:52.888855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:52.888855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:52.888855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 229/460] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:52.897644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:52.946421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc33473-bd5c-477b-8620-966ee12d3a25 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:53.010380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:53.010380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.010380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.010380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.035711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:53.037183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:53.044740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:53.068545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:53.070138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:53.070945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:53.070945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:53.070945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:53.070945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:53.079705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 232/461] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:53.080689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:53.106817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93ad8-e20f-4578-824b-7421f83c9d1d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:53.169683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821239c-4de4-4a28-8ad1-3cfbaa333337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:53.170307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821239c-4de4-4a28-8ad1-3cfbaa333337 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.170588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821239c-4de4-4a28-8ad1-3cfbaa333337 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.170862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821239c-4de4-4a28-8ad1-3cfbaa333337 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.171571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821239c-4de4-4a28-8ad1-3cfbaa333337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:53.171874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821239c-4de4-4a28-8ad1-3cfbaa333337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:53.173276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821239c-4de4-4a28-8ad1-3cfbaa333337 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:53.188099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 230/462] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:53.189653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3082e-0836-496d-b49d-12e002d279e7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.190053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3082e-0836-496d-b49d-12e002d279e7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.190331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3082e-0836-496d-b49d-12e002d279e7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.196758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 231/463] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:53.196758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3082e-0836-496d-b49d-12e002d279e7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:53.248500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:53.262483 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abc3d-f142-4244-bf1f-13efd2f93c57 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:53.305945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02f675-d94e-4aaa-8b91-8f3a9d5707bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:53.306920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02f675-d94e-4aaa-8b91-8f3a9d5707bd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.307447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02f675-d94e-4aaa-8b91-8f3a9d5707bd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.307916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02f675-d94e-4aaa-8b91-8f3a9d5707bd None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.308793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02f675-d94e-4aaa-8b91-8f3a9d5707bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:53.309288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02f675-d94e-4aaa-8b91-8f3a9d5707bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:53.310903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02f675-d94e-4aaa-8b91-8f3a9d5707bd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:53.328775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 233/464] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:53.330735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577a4f-6f78-4bc0-8725-ca89e14c26d3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.331225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577a4f-6f78-4bc0-8725-ca89e14c26d3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.331718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577a4f-6f78-4bc0-8725-ca89e14c26d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.336772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3082e-0836-496d-b49d-12e002d279e7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:53.352910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3d577a4f-6f78-4bc0-8725-ca89e14c26d3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:53.354402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3d577a4f-6f78-4bc0-8725-ca89e14c26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:53.383160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0ac6b-6914-42fa-856f-896fd7455280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:53.384181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ac6b-6914-42fa-856f-896fd7455280 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.384643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ac6b-6914-42fa-856f-896fd7455280 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.385227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ac6b-6914-42fa-856f-896fd7455280 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.386464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0ac6b-6914-42fa-856f-896fd7455280 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:53.388979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0ac6b-6914-42fa-856f-896fd7455280 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:53.431408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 232/465] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:53 2022] POST /identity/v3/users => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:53.431639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:53.431734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228fe6-0688-412a-b152-5124a31bbfc7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.431734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228fe6-0688-412a-b152-5124a31bbfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.431734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228fe6-0688-412a-b152-5124a31bbfc7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.431734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 233/466] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:53.431734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b228fe6-0688-412a-b152-5124a31bbfc7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:53.467394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 234/467] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:53.469747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4730c-0b3e-4fac-8482-efd620dad289 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.470402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4730c-0b3e-4fac-8482-efd620dad289 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.470947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4730c-0b3e-4fac-8482-efd620dad289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.507403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e6d4730c-0b3e-4fac-8482-efd620dad289 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:53.509818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e6d4730c-0b3e-4fac-8482-efd620dad289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:53.581821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:53.596850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b228fe6-0688-412a-b152-5124a31bbfc7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:53.633046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 235/468] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:53.634613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4730c-0b3e-4fac-8482-efd620dad289 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:53.645341 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608743e-56a6-42e9-a5ac-3abdf668a5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:53.646292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608743e-56a6-42e9-a5ac-3abdf668a5ae None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.646806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608743e-56a6-42e9-a5ac-3abdf668a5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.647924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608743e-56a6-42e9-a5ac-3abdf668a5ae None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.648877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608743e-56a6-42e9-a5ac-3abdf668a5ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:53.650652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608743e-56a6-42e9-a5ac-3abdf668a5ae None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:53.680416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 234/469] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:53 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:53.681234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608743e-56a6-42e9-a5ac-3abdf668a5ae None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:53.766177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4730c-0b3e-4fac-8482-efd620dad289 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:53.784659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:53.829204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:53.830258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.830738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.831209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.844995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608743e-56a6-42e9-a5ac-3abdf668a5ae None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:53.856857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:53.858777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:53.878980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:53.879898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:53.880742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:53.880742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:53.880742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:53.880742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:53.883837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 236/470] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:53.889710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:53.908220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:53.908874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:53.909155 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:53.909429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:53.921612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:53.923087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:53.942531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:53.943471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:53.944873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:53.944873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:53.944873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:53.944873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:53.945566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 235/471] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:53.956497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:53.967651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:54.015970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929ed9-44fd-48a8-8e64-16c308b5a34f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:54.055130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3300ab-5f5d-41cd-a78a-9460ecc7c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:54.055792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3300ab-5f5d-41cd-a78a-9460ecc7c93b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:54.056120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3300ab-5f5d-41cd-a78a-9460ecc7c93b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:54.056401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3300ab-5f5d-41cd-a78a-9460ecc7c93b None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:54.057106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3300ab-5f5d-41cd-a78a-9460ecc7c93b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:54.057415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3300ab-5f5d-41cd-a78a-9460ecc7c93b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:54.058823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3300ab-5f5d-41cd-a78a-9460ecc7c93b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:54.072584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 237/472] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:54.073962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a925-86fd-48bd-b31f-b708c6ea70ef None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:54.074255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a925-86fd-48bd-b31f-b708c6ea70ef None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:54.074528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a925-86fd-48bd-b31f-b708c6ea70ef None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:54.076032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 238/473] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:54.083765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8dcbd-678f-463e-9722-e430b952cb0c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:54.083939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8dcbd-678f-463e-9722-e430b952cb0c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:54.084314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8dcbd-678f-463e-9722-e430b952cb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:54.093737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e0c7-5a32-4a0d-b160-1e1ba3f6bfc9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:54.104072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7cf8dcbd-678f-463e-9722-e430b952cb0c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:54.105394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7cf8dcbd-678f-463e-9722-e430b952cb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:54.127206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:54.131116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:54.132558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:54.133002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:54.133417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:54.134309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:54.134752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:54.136368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:54.149934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 236/474] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:54.151054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:54.194355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 239/475] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:54.195317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8dcbd-678f-463e-9722-e430b952cb0c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:54.239638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:54.294358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79530-de27-4b94-ab36-ea21c1bfa91a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:54.321968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8dcbd-678f-463e-9722-e430b952cb0c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:54.338776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a6576-97a1-45a7-809d-00b178bdd181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:54.339692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a6576-97a1-45a7-809d-00b178bdd181 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:54.339977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a6576-97a1-45a7-809d-00b178bdd181 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:54.340252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a6576-97a1-45a7-809d-00b178bdd181 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:54.341114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a6576-97a1-45a7-809d-00b178bdd181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:54.342882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a6576-97a1-45a7-809d-00b178bdd181 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:54.361794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71620-9321-4521-9889-ec3e0bd5374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:54.362607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71620-9321-4521-9889-ec3e0bd5374a None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:54.362910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71620-9321-4521-9889-ec3e0bd5374a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:54.363398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71620-9321-4521-9889-ec3e0bd5374a None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:54.364410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c71620-9321-4521-9889-ec3e0bd5374a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:54.366617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c71620-9321-4521-9889-ec3e0bd5374a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:54.371860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 237/476] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:54 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:54.372949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a6576-97a1-45a7-809d-00b178bdd181 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:54.407132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 240/477] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:54 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:54.563156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a6576-97a1-45a7-809d-00b178bdd181 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:54.588637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:54.604750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:54.605647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:54.606116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:54.606490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:54.607795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:54.609202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:54.620795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.sql.core [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:23:54.620795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 15:23:54.620795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [parameters: {'id': 'd4b41820d03546eca0e4912413f02541', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 15:23:54.620795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80435) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Aug 01 15:23:54.646347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return ref.to_dict() Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:23:54.647945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application yield resource Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise self.value Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application session.commit() Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:23:54.648866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:23:54.649679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:23:54.650575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:23:54.651447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [parameters: {'id': 'd4b41820d03546eca0e4912413f02541', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:54.654071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 15:23:54.656248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:54.659907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 238/478] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Aug 1 15:23:54 2022] POST /identity/v3/roles => generated 144 bytes in 276 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:54.660074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71620-9321-4521-9889-ec3e0bd5374a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:54.678472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:54.793332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71620-9321-4521-9889-ec3e0bd5374a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:54.835696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada90e0-7e11-4ca9-98d5-5993b2af710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:54.836362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada90e0-7e11-4ca9-98d5-5993b2af710c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:54.836710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada90e0-7e11-4ca9-98d5-5993b2af710c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:54.836992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada90e0-7e11-4ca9-98d5-5993b2af710c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:54.858686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada90e0-7e11-4ca9-98d5-5993b2af710c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4ada90e0-7e11-4ca9-98d5-5993b2af710c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:54.864561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:54.865423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:54.866323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 241/479] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:23:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:23:54.872524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:55.015348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3f7e5-d9a2-42a1-944d-b0584077d83a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:55.064946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe34a6-b8da-4a86-9c2b-6f2516c0198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:55.065585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe34a6-b8da-4a86-9c2b-6f2516c0198f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:55.065870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe34a6-b8da-4a86-9c2b-6f2516c0198f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:55.066148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe34a6-b8da-4a86-9c2b-6f2516c0198f None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:55.066879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe34a6-b8da-4a86-9c2b-6f2516c0198f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:55.067188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe34a6-b8da-4a86-9c2b-6f2516c0198f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:55.068607 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe34a6-b8da-4a86-9c2b-6f2516c0198f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:55.082932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 239/480] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:23:56.228046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a04579-8293-4f1f-8e06-509a47da318b None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:56.229063 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a04579-8293-4f1f-8e06-509a47da318b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:56.229592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a04579-8293-4f1f-8e06-509a47da318b None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:56.236803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 242/481] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:56.248259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e952-85c0-44f2-a4ed-7e862b36f6dc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:56.249054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e952-85c0-44f2-a4ed-7e862b36f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:56.249599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e952-85c0-44f2-a4ed-7e862b36f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:56.269510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2d69e952-85c0-44f2-a4ed-7e862b36f6dc None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:56.271039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2d69e952-85c0-44f2-a4ed-7e862b36f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:56.293490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154e8e-1a10-448a-9b47-bf9df91d3cbe None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:56.294085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154e8e-1a10-448a-9b47-bf9df91d3cbe None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:56.294562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154e8e-1a10-448a-9b47-bf9df91d3cbe None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:56.296407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 243/482] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:56.301878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224d05-6460-4117-b199-83895dcded3d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:56.302398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224d05-6460-4117-b199-83895dcded3d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:56.302897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224d05-6460-4117-b199-83895dcded3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:56.327757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0d224d05-6460-4117-b199-83895dcded3d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:56.331677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0d224d05-6460-4117-b199-83895dcded3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:56.366153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:56.417277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 240/483] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:56.456356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 244/484] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:56.468088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e952-85c0-44f2-a4ed-7e862b36f6dc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:56.495303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d224d05-6460-4117-b199-83895dcded3d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:56.497898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:56.643158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e952-85c0-44f2-a4ed-7e862b36f6dc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:56.676907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d224d05-6460-4117-b199-83895dcded3d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:56.702302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bc265-d215-4a51-8d05-138a8b88641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:56.703021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc265-d215-4a51-8d05-138a8b88641a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:56.703340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc265-d215-4a51-8d05-138a8b88641a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:56.703684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc265-d215-4a51-8d05-138a8b88641a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:56.723323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bc265-d215-4a51-8d05-138a8b88641a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-042bc265-d215-4a51-8d05-138a8b88641a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:56.731059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:56.731976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:23:56.732741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:56.733857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 241/485] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:23:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:56.742241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bc265-d215-4a51-8d05-138a8b88641a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:56.748681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccd68e-6d96-4b32-890e-07e03fec5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:56.749272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd68e-6d96-4b32-890e-07e03fec5582 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:56.749552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd68e-6d96-4b32-890e-07e03fec5582 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:56.749824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd68e-6d96-4b32-890e-07e03fec5582 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:56.774013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccd68e-6d96-4b32-890e-07e03fec5582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-aeccd68e-6d96-4b32-890e-07e03fec5582 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:56.779927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:56.780784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:56.781527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 245/486] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:23:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:56.790027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccd68e-6d96-4b32-890e-07e03fec5582 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:56.808320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:56.910884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:56.924842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bc265-d215-4a51-8d05-138a8b88641a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:56.977280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccd68e-6d96-4b32-890e-07e03fec5582 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.007726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5a0e2-c9dc-45e3-a904-e332b80d9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.009039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a0e2-c9dc-45e3-a904-e332b80d9b0e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.009519 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a0e2-c9dc-45e3-a904-e332b80d9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.009985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a0e2-c9dc-45e3-a904-e332b80d9b0e None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.010897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5a0e2-c9dc-45e3-a904-e332b80d9b0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:57.011409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5a0e2-c9dc-45e3-a904-e332b80d9b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.013003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5a0e2-c9dc-45e3-a904-e332b80d9b0e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.017184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da092-b721-4fe9-a302-ed6cfc774308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.017826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da092-b721-4fe9-a302-ed6cfc774308 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.018111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da092-b721-4fe9-a302-ed6cfc774308 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.018387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da092-b721-4fe9-a302-ed6cfc774308 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.019116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2da092-b721-4fe9-a302-ed6cfc774308 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:57.019451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2da092-b721-4fe9-a302-ed6cfc774308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.020865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2da092-b721-4fe9-a302-ed6cfc774308 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.025327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 242/487] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:23:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:57.026856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32246-fcdb-4633-bd83-c0eee5037f76 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.027403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32246-fcdb-4633-bd83-c0eee5037f76 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.027975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32246-fcdb-4633-bd83-c0eee5037f76 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.029700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 243/488] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:57.036168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e32246-fcdb-4633-bd83-c0eee5037f76 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.036325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 246/489] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:23:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:57.037479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf032-78d1-4ef0-a369-22d0dee6844d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.039405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf032-78d1-4ef0-a369-22d0dee6844d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.039405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf032-78d1-4ef0-a369-22d0dee6844d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.057414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0fdbf032-78d1-4ef0-a369-22d0dee6844d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:57.058655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0fdbf032-78d1-4ef0-a369-22d0dee6844d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:57.134482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 247/490] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:57.135459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf032-78d1-4ef0-a369-22d0dee6844d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.146229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:57.156969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e32246-fcdb-4633-bd83-c0eee5037f76 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.193374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.194044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.194866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.195143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.206174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:57.206295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.207706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:57.223037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:57.224038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:57.229955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:57.229955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:57.229955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:57.229955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:57.229955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 244/491] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:57.229955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.267784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf032-78d1-4ef0-a369-22d0dee6844d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.304351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022f28b-462e-4dec-af57-1c4591322cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.304999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f28b-462e-4dec-af57-1c4591322cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.305280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f28b-462e-4dec-af57-1c4591322cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.305552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f28b-462e-4dec-af57-1c4591322cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.316060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022f28b-462e-4dec-af57-1c4591322cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.317536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022f28b-462e-4dec-af57-1c4591322cc9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b022f28b-462e-4dec-af57-1c4591322cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:57.333849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:57.334774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:57.335648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:57.335648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:57.335648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:57.335648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:57.335872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ff53-8ac2-4942-9f71-df064e499719 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.339693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 248/492] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:57.340984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c57ef-7e5e-4ddc-871d-a4b0a2dd40d7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.341273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c57ef-7e5e-4ddc-871d-a4b0a2dd40d7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.341548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c57ef-7e5e-4ddc-871d-a4b0a2dd40d7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.342828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 249/493] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:57.343530 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c57ef-7e5e-4ddc-871d-a4b0a2dd40d7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.378722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94958-be1c-4497-9c66-f66209e8362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.379360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94958-be1c-4497-9c66-f66209e8362c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.379669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94958-be1c-4497-9c66-f66209e8362c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.379941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94958-be1c-4497-9c66-f66209e8362c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.391782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c94958-be1c-4497-9c66-f66209e8362c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-30c94958-be1c-4497-9c66-f66209e8362c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:57.397335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:57.398433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:57.399198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 245/494] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:57.400240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94958-be1c-4497-9c66-f66209e8362c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.420372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:57.474185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c57ef-7e5e-4ddc-871d-a4b0a2dd40d7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.482464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:57.523007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6e424-41c9-4810-9527-11d8f5577edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.523689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6e424-41c9-4810-9527-11d8f5577edd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.523976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6e424-41c9-4810-9527-11d8f5577edd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.524384 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6e424-41c9-4810-9527-11d8f5577edd None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.525473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6e424-41c9-4810-9527-11d8f5577edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:57.525969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6e424-41c9-4810-9527-11d8f5577edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.527411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6e424-41c9-4810-9527-11d8f5577edd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.535425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94958-be1c-4497-9c66-f66209e8362c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.540595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 250/495] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:57.544833 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b366-e13b-4450-baed-01b7fe4a3122 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.545304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b366-e13b-4450-baed-01b7fe4a3122 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.545582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b366-e13b-4450-baed-01b7fe4a3122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.564377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b263b366-e13b-4450-baed-01b7fe4a3122 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:57.565594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b263b366-e13b-4450-baed-01b7fe4a3122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:57.574457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.575088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.575394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.575673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.576370 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:57.576675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.578065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.591291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 246/496] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:57.596536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.636879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 251/497] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:57.637741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263b366-e13b-4450-baed-01b7fe4a3122 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.686883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:57.723317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfc066-c83f-479d-be8c-491533f83684 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.750937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:57.758327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263b366-e13b-4450-baed-01b7fe4a3122 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.765324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.766288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.766762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.767295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.768365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:57.768860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.770558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.779470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 247/498] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:57.780688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.798995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.799756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.800045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.800333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.808937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.810416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:23:57.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:57.824387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:57.825248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 252/499] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:57.826344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.897340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff932b-dbb0-4411-bd87-d236baea3fc9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.927024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:57.932616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61685d4e-921f-4620-b03b-17a28bee4965 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:57.933413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.934070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.934355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.934637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.942302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:57.943789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:23:57.956826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:57.957759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 248/500] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:57.958729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:57.971617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f3954-b1a7-4d1c-92bc-013fd6555377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:57.972262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f3954-b1a7-4d1c-92bc-013fd6555377 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:57.972546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f3954-b1a7-4d1c-92bc-013fd6555377 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:57.972820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f3954-b1a7-4d1c-92bc-013fd6555377 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:57.983683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f3954-b1a7-4d1c-92bc-013fd6555377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-603f3954-b1a7-4d1c-92bc-013fd6555377 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:23:57.989061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:57.990114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:57.990956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 253/501] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:57.991641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f3954-b1a7-4d1c-92bc-013fd6555377 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.010039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.071802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c7c3-2337-4340-816c-edcc8384ab08 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.103198 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f3954-b1a7-4d1c-92bc-013fd6555377 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.106881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02a777-3b19-4a5d-be8a-2f292435d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.107554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a777-3b19-4a5d-be8a-2f292435d825 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.107840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a777-3b19-4a5d-be8a-2f292435d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.108116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a777-3b19-4a5d-be8a-2f292435d825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.125012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02a777-3b19-4a5d-be8a-2f292435d825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.126495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02a777-3b19-4a5d-be8a-2f292435d825 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.138682 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.139416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.139787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.140166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2a02a777-3b19-4a5d-be8a-2f292435d825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:58.140761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:58.142558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:58.144539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:58.144539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:58.144539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:58.144539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:58.144998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:58.144998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.144998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.146576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 249/502] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:58.148219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb407bb-2961-4e3d-a256-b38dc3e06d0a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.148506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb407bb-2961-4e3d-a256-b38dc3e06d0a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.148783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb407bb-2961-4e3d-a256-b38dc3e06d0a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.150058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 250/503] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:23:58.150744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb407bb-2961-4e3d-a256-b38dc3e06d0a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.185460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 254/504] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:23:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:58.186298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.199204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.258716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb407bb-2961-4e3d-a256-b38dc3e06d0a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.270800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.293182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.293795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.294078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.294353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.295144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:58.295480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.296928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.298886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa3e4-a45c-40ae-8dd8-86723f95cdaa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.333435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347f8b8-5270-4246-a092-2a7ee0e4583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.334013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347f8b8-5270-4246-a092-2a7ee0e4583b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.334330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347f8b8-5270-4246-a092-2a7ee0e4583b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.334536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 251/505] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:58.334639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347f8b8-5270-4246-a092-2a7ee0e4583b None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.335931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347f8b8-5270-4246-a092-2a7ee0e4583b None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:58.336029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.336473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347f8b8-5270-4246-a092-2a7ee0e4583b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.337609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347f8b8-5270-4246-a092-2a7ee0e4583b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.346030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 255/506] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:58.347302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d05af-4d3c-4ebb-99d3-ab5a79f812c1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.347645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d05af-4d3c-4ebb-99d3-ab5a79f812c1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.348042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d05af-4d3c-4ebb-99d3-ab5a79f812c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.367467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-421d05af-4d3c-4ebb-99d3-ab5a79f812c1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:23:58.368713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-421d05af-4d3c-4ebb-99d3-ab5a79f812c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:23:58.440828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 256/507] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:58.441866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d05af-4d3c-4ebb-99d3-ab5a79f812c1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.456621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bcf42-5a70-42db-bcb5-1c15d8c73f32 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.458342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.494201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.494819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.495104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.495392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.496125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:58.496429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.497822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.509731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 252/508] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:58.510558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.513692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.552264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d05af-4d3c-4ebb-99d3-ab5a79f812c1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.587476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d30c8-9981-426f-b43d-fb895e5bc83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.588037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d30c8-9981-426f-b43d-fb895e5bc83e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.588393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d30c8-9981-426f-b43d-fb895e5bc83e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.588782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d30c8-9981-426f-b43d-fb895e5bc83e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.609832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1f5d-5509-4fbf-bc59-fa96c242fd8f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.643256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa82d52-b11d-492e-adaa-4ca157c7319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.644125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa82d52-b11d-492e-adaa-4ca157c7319c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.644401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa82d52-b11d-492e-adaa-4ca157c7319c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.644675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa82d52-b11d-492e-adaa-4ca157c7319c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.657404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d30c8-9981-426f-b43d-fb895e5bc83e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.659025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d30c8-9981-426f-b43d-fb895e5bc83e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.676295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.717313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa82d52-b11d-492e-adaa-4ca157c7319c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.718777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa82d52-b11d-492e-adaa-4ca157c7319c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.724750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.764880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 257/509] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:58.765911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d30c8-9981-426f-b43d-fb895e5bc83e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.826233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 253/510] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:58.827090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa82d52-b11d-492e-adaa-4ca157c7319c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.867827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d30c8-9981-426f-b43d-fb895e5bc83e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.889425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.902728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.903360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.903672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.903954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.915571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.917029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.930990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa82d52-b11d-492e-adaa-4ca157c7319c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:58.931702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:58.932621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:58.938094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:58.938094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:58.938094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:58.938094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:58.938094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 258/511] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:58.938094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:58.956037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:58.966373 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:58.967008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.967286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.967590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.978547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:58.980027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:58.994964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:58.996046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:58.997063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:58.997063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:58.997063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:58.997063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:58.999514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 254/512] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:59.000538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.055201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c077db-3f2c-44db-810c-23474c4b4f53 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.089796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957742-99cf-4330-b700-13db258c966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.090555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957742-99cf-4330-b700-13db258c966b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.090843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957742-99cf-4330-b700-13db258c966b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.092110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957742-99cf-4330-b700-13db258c966b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.098609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957742-99cf-4330-b700-13db258c966b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.100105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957742-99cf-4330-b700-13db258c966b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.101634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2787c-9c07-47b0-a59b-d2e1bc1f9560 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f5957742-99cf-4330-b700-13db258c966b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:23:59.111354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:59.112461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 259/513] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:59.113489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957742-99cf-4330-b700-13db258c966b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.118699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:59.139049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.139785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.140067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.140339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.151832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.153315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:59.168084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:59.169623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:59.171168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:59.171168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:59.171168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:59.171168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:23:59.171168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 255/514] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:59.171168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.199217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:59.220748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957742-99cf-4330-b700-13db258c966b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.257829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.258479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.258763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.259038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.274483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239ebb5-40fa-43fa-b250-b3bb153b2e52 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.275012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.276540 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:23:59.296554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:59.302030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:59.304788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:23:59.304788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:23:59.304788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:23:59.304788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:59.304788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 260/515] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:59.304788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.316640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.317261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.317539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.317810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.318504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:59.318809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.320272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.334996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 256/516] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:59.335907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.367505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:59.433141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62791e5f-2b2d-41fe-9070-546307cccf84 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.457025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d3f8-d816-4599-94fa-e1b39f68dd0b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.466964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:59.474000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.474642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.474929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.475208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.476770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:59.477299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.479902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.493782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 261/517] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:59.494681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.497148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.497981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.498568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.498849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.499694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:59.500001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.501445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.519343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 257/518] 10.222.0.71 () {56 vars in 1139 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:59.520206 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.611566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682835-4e10-4aca-a6c2-f692959bcbfd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.614885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:59.635707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b24bb3-2cd2-471e-9140-f738a9c66cbd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.647841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.648464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.648749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.649027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.649730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:59.650037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.651508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.665333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 262/519] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:59.666171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.675585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.676753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.677052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.677331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.678037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:23:59.678343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.679883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.693817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 258/520] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:23:59.694297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.726631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:59.784800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65119b-a296-42bd-be32-e5895795a69d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.824610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ad8d-cb72-44f1-9d0e-42e77a0ae7eb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:23:59.827396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.828037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.828310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.828581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.837029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.838481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:23:59.850626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:23:59.851621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:23:59.852471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 263/521] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:23:59.853037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.869598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526175dc-7367-48a0-a5f8-1cd944cd19ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:23:59.870228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526175dc-7367-48a0-a5f8-1cd944cd19ee None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:59.870512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526175dc-7367-48a0-a5f8-1cd944cd19ee None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:59.870795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526175dc-7367-48a0-a5f8-1cd944cd19ee None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:59.871515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526175dc-7367-48a0-a5f8-1cd944cd19ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:23:59.872977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526175dc-7367-48a0-a5f8-1cd944cd19ee None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:23:59.891723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:59.896651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 259/522] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:23:59 2022] POST /identity/v3/users => generated 247 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:23:59.898469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526175dc-7367-48a0-a5f8-1cd944cd19ee None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:23:59.997217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57821e-36ae-4caa-b9f2-49748e64a71a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.010969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:00.056576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd72b-f97f-4aa3-9614-e7f32ba9cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.057311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd72b-f97f-4aa3-9614-e7f32ba9cc87 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.057752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd72b-f97f-4aa3-9614-e7f32ba9cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.058044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd72b-f97f-4aa3-9614-e7f32ba9cc87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.063149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526175dc-7367-48a0-a5f8-1cd944cd19ee None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.122731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.123409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.123701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.123999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.134980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:00.136487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:00.153609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:00.154673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:00.155756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 260/523] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:00.156380 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:00.170218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dd72b-f97f-4aa3-9614-e7f32ba9cc87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:00.172309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dd72b-f97f-4aa3-9614-e7f32ba9cc87 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:00.231196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:00.297659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7f794-95f1-4378-8521-21a283babb70 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.311529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 264/524] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:00.311529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd72b-f97f-4aa3-9614-e7f32ba9cc87 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:00.325037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:00.351660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.352752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.353443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.354148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.365597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:00.367647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:00.381266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:00.383216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 261/525] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:00.384585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:00.449551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd72b-f97f-4aa3-9614-e7f32ba9cc87 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.495030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.495697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.495982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.496261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.497072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:00.497384 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:00.498862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:00.512675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e66c6-8ae9-45d0-9603-8736caaeb688 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.521324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 265/526] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Aug 1 15:24:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:00.522200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:00.542466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:00.559789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.560758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.561162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.561553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.562475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:00.562791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:00.564329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:00.591855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 262/527] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:00.591855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:00.622907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:00.669288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38307-67e7-4d7f-b6cd-e32c27eb7b5b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.731822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.732479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.732756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.733113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.743657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f003fbd-1928-4ebc-a7b2-89323d1cbdce None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.750007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:00.751662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:00.769367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:00.770241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:00.771050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:00.771050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:00.771050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:00.771050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:00.771050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 266/528] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:00.771329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:00.791403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.792044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.792332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.792651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.793417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:00.793729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:00.795200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:00.808973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 263/529] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:00.814370 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:00.858909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:00.884140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad85bf-c40d-43cd-81ab-d3e107e0a449 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.906805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:00.924379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9588b-f062-4ffe-8669-ec10dc929224 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:00.925981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02391e-2aa7-407e-a16e-b494731dffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.926718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02391e-2aa7-407e-a16e-b494731dffe6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.927002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02391e-2aa7-407e-a16e-b494731dffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.927278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02391e-2aa7-407e-a16e-b494731dffe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.959267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:00.960491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:00.960775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:00.961046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:00.961835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:00.962143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:00.963621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:00.969263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 264/530] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:00 2022] GET /identity/v3/role_assignments?user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:00.970046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:01.019244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02391e-2aa7-407e-a16e-b494731dffe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:01.020837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02391e-2aa7-407e-a16e-b494731dffe6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:01.114826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345d6b7-17e3-4c5a-8918-edbf25cd296b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:01.140003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:01.149545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 267/531] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:01.150426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02391e-2aa7-407e-a16e-b494731dffe6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:01.160880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:01.162355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:01.163461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:01.164376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:01.165873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:01.166414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:01.168939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:01.175498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:01.191741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 265/532] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:01.191741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:01.284015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02391e-2aa7-407e-a16e-b494731dffe6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:01.320193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00d9f0-1012-442e-9df6-11707e9db038 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:01.326276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:01.326998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:01.327346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:01.327706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:01.328987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=f03250eb151044619c0f720f315b8509) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:01.329368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:01.331273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:01.338856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 268/533] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:01 2022] GET /identity/v3/role_assignments?user.id=f03250eb151044619c0f720f315b8509&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:01.344262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:01.391387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:01.392259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:01.392644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:01.393023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:01.425838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:01.427535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:01.460974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:01.462055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:01.463080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:01.463080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:01.463080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:01.463080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:01.465110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 266/534] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:01.470677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:01.502366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:01.517533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:01.566357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167e92f-aecd-4d76-85e7-239be3f84897 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:01.599899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7df37-0661-4a71-8252-5171f084353a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:01.635650 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:01.636275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:01.636559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:01.636951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:01.637648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:01.637957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:01.639529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:01.652979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 267/535] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:01.658850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:01.659713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:01.660497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:01.660878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:01.661253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:01.680572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:01.682192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:01.720126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:01.721149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:01.721972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:01.721972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:01.721972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:01.721972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:01.721972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:01.721972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:01.721972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:01.721972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:01.722698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 269/536] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:01.732435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:01.747628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:01.768172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645cef-1b0e-489d-9229-0ba0ade7c94e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:01.806001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:01.806657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:01.806941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:01.807216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:01.814652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:01.816252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:01.832167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:01.833032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:01.833882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 268/537] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:01.839198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:01.945306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b14b1-a9b5-47c5-bc41-6563c033c4e8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:01.967729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf76d9-1450-4571-9d8b-03b0269f43ee None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:01.986275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:01.988922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:01.989373 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:01.989698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:01.990468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:01.990775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:01.994689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:02.010516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:02.019641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 269/538] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:02.026576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:02.047278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:02.047955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:02.048259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:02.048592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:02.049572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:02.049887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:02.051504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:02.100090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 270/539] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:02.103738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:02.110083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:02.244581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777615-bff5-4c4b-93c1-7c0e1f6637dc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:02.293523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ee8f5-ac42-483c-9bcf-b0f930998196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:02.294147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee8f5-ac42-483c-9bcf-b0f930998196 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:02.294425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee8f5-ac42-483c-9bcf-b0f930998196 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:02.294699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee8f5-ac42-483c-9bcf-b0f930998196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:02.295513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ee8f5-ac42-483c-9bcf-b0f930998196 None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=79a4e12e752446f296569df09f2ac824) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:02.295826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ee8f5-ac42-483c-9bcf-b0f930998196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:02.297331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ee8f5-ac42-483c-9bcf-b0f930998196 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:02.298130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f223f7e-c67b-4298-84b9-48233830829d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:02.304815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 270/540] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:02 2022] GET /identity/v3/role_assignments?user.id=79a4e12e752446f296569df09f2ac824&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:02.306181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaea8b-0e6f-4a0b-a815-55421ebde5b6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:02.306525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaea8b-0e6f-4a0b-a815-55421ebde5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:02.306809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaea8b-0e6f-4a0b-a815-55421ebde5b6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:02.308484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 271/541] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:02.315669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850d39-cedb-4b06-b37c-bdb59947880a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:02.316139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850d39-cedb-4b06-b37c-bdb59947880a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:02.316489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850d39-cedb-4b06-b37c-bdb59947880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:02.337158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3a850d39-cedb-4b06-b37c-bdb59947880a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:02.338545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3a850d39-cedb-4b06-b37c-bdb59947880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:02.354036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3018359-d899-4e76-9186-906e22875132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:02.354776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3018359-d899-4e76-9186-906e22875132 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:02.354884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3018359-d899-4e76-9186-906e22875132 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:02.355129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3018359-d899-4e76-9186-906e22875132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:02.355970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3018359-d899-4e76-9186-906e22875132 None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=1a1f3e1faeba451488854da4236359ac) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:02.356288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3018359-d899-4e76-9186-906e22875132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:02.357784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3018359-d899-4e76-9186-906e22875132 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:02.372393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 271/542] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:02 2022] GET /identity/v3/role_assignments?user.id=1a1f3e1faeba451488854da4236359ac&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:02.409256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:02.425476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 272/543] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:02.458477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3018359-d899-4e76-9186-906e22875132 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:02.558349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:02.596792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3018359-d899-4e76-9186-906e22875132 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:02.639128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4793182-a5df-442f-9fd3-0af88a23e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:02.639954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793182-a5df-442f-9fd3-0af88a23e0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:02.640249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793182-a5df-442f-9fd3-0af88a23e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:02.640609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793182-a5df-442f-9fd3-0af88a23e0e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:02.656757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4793182-a5df-442f-9fd3-0af88a23e0e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f4793182-a5df-442f-9fd3-0af88a23e0e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:02.662246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:02.663766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:02.665460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 272/544] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:02.672480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850d39-cedb-4b06-b37c-bdb59947880a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:02.817402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850d39-cedb-4b06-b37c-bdb59947880a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:02.866961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:02.867630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:02.867910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:02.868183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:02.868914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:02.869220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:02.870597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:02.884185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 273/545] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:02.889355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4793182-a5df-442f-9fd3-0af88a23e0e5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:02.999292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4793182-a5df-442f-9fd3-0af88a23e0e5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:03.029234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:03.038024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587aff2-6733-4e41-84a3-2aadd9b01a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:03.038736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587aff2-6733-4e41-84a3-2aadd9b01a04 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.039019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587aff2-6733-4e41-84a3-2aadd9b01a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.039295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587aff2-6733-4e41-84a3-2aadd9b01a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.050672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587aff2-6733-4e41-84a3-2aadd9b01a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:03.052225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587aff2-6733-4e41-84a3-2aadd9b01a04 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b587aff2-6733-4e41-84a3-2aadd9b01a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:03.072094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:03.073234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:03.074385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:03.074385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:03.074385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:03.074385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:03.074385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 273/546] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:03.080800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:03.146861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:03.198216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3011882-e7db-4980-9b6d-e12f9f34a74e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:03.238710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:03.239341 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.239707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.239985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.240731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:03.241569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:03.242953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:03.253163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5502-c6f0-43c6-9050-09c4da63382d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.253442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5502-c6f0-43c6-9050-09c4da63382d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.253813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5502-c6f0-43c6-9050-09c4da63382d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.255074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 274/547] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:03.260958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 274/548] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:03.265953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aba8c-de10-4eae-9b24-4903bb2df7d9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.266403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aba8c-de10-4eae-9b24-4903bb2df7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.266886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aba8c-de10-4eae-9b24-4903bb2df7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.271967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:03.293689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2b1aba8c-de10-4eae-9b24-4903bb2df7d9 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:03.295531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2b1aba8c-de10-4eae-9b24-4903bb2df7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:03.378095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 275/549] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:03.403474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aba8c-de10-4eae-9b24-4903bb2df7d9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:03.503290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ee0ea-2f0e-4aa2-9bba-aa2d22e0f78f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:03.533420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:03.541997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aba8c-de10-4eae-9b24-4903bb2df7d9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:03.564592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:03.582828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:03.583747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.584199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.584644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.598149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:03.600957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:03.615365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b1274-e37e-4399-9e52-e038204c9e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:03.616882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b1274-e37e-4399-9e52-e038204c9e85 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.617306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b1274-e37e-4399-9e52-e038204c9e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.617721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b1274-e37e-4399-9e52-e038204c9e85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:03.628219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:03.629919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:03.631157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:03.637071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 275/550] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:03.638325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b1274-e37e-4399-9e52-e038204c9e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:03.642615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c83b1274-e37e-4399-9e52-e038204c9e85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:03.644275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:03.645157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:03.646142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:03.649775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 276/551] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:03.656398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b1274-e37e-4399-9e52-e038204c9e85 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:03.805524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fbc22-b410-4f15-b402-da32a1eb7e38 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:03.842466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:03.843426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.843898 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.844353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.845404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:03.845917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:03.847557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:03.857350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b1274-e37e-4399-9e52-e038204c9e85 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:03.867630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 276/552] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Aug 1 15:24:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:03.872763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:03.900064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9a787-37da-44ee-8c03-f3a2383e6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:03.900689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a787-37da-44ee-8c03-f3a2383e6644 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.900970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a787-37da-44ee-8c03-f3a2383e6644 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.901244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a787-37da-44ee-8c03-f3a2383e6644 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.901953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9a787-37da-44ee-8c03-f3a2383e6644 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:03.902258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9a787-37da-44ee-8c03-f3a2383e6644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:03.903676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9a787-37da-44ee-8c03-f3a2383e6644 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:03.912702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 277/553] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:03.915426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:03.915563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ca3f-4587-49cc-bcd6-d53519d27b53 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:03.915563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ca3f-4587-49cc-bcd6-d53519d27b53 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:03.915563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ca3f-4587-49cc-bcd6-d53519d27b53 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:03.920749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 278/554] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:03.921677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64ca3f-4587-49cc-bcd6-d53519d27b53 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:03.964795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:04.002831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a6a88-e2b4-4370-913b-3e0289e85d8a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.039995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699de1-1711-4155-8961-d7f45c69be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.040622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699de1-1711-4155-8961-d7f45c69be91 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.040992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699de1-1711-4155-8961-d7f45c69be91 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.041173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699de1-1711-4155-8961-d7f45c69be91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.067039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64ca3f-4587-49cc-bcd6-d53519d27b53 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.111985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6912-d09d-4baa-b5b4-cce076f59520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.112644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6912-d09d-4baa-b5b4-cce076f59520 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.112923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6912-d09d-4baa-b5b4-cce076f59520 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.113195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6912-d09d-4baa-b5b4-cce076f59520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.123572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8699de1-1711-4155-8961-d7f45c69be91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:04.124931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a6912-d09d-4baa-b5b4-cce076f59520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:04.125894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8699de1-1711-4155-8961-d7f45c69be91 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:04.126793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a6912-d09d-4baa-b5b4-cce076f59520 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-0f0a6912-d09d-4baa-b5b4-cce076f59520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:04.142949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:04.143877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:04.144712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:04.144712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:04.144712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:04.144712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:04.149494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 279/555] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:04.150806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8add6c-5444-4885-8a87-f9aa48ebbbcf None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.151095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8add6c-5444-4885-8a87-f9aa48ebbbcf None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.151659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8add6c-5444-4885-8a87-f9aa48ebbbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.166983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:04.175109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0e8add6c-5444-4885-8a87-f9aa48ebbbcf None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:04.176413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0e8add6c-5444-4885-8a87-f9aa48ebbbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:04.264733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 277/557] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:04.265913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699de1-1711-4155-8961-d7f45c69be91 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:04.268708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 280/557] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:04.271275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8add6c-5444-4885-8a87-f9aa48ebbbcf None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:04.299756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:04.391197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8add6c-5444-4885-8a87-f9aa48ebbbcf None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.395095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699de1-1711-4155-8961-d7f45c69be91 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.429753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.430489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.430862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.431237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.432250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:04.439873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.440798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.441231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.441649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.442517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:04.442793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:04.443188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:04.445016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:04.445684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:04.458912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 278/558] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:04.462599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:04.464016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:04.465034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:04.465034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:04.465034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:04.465034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:04.465941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:04.467231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 281/559] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:04.468728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:04.542994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:04.585832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14221a-2996-49f0-acee-595509c2c99e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.593704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43756-1577-4a81-a236-2ba6c7685582 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.622584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.623609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.624073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.624526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.632733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dde154-2dea-4825-af0d-74ec8006df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.633317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde154-2dea-4825-af0d-74ec8006df6f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.633601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde154-2dea-4825-af0d-74ec8006df6f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.633871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde154-2dea-4825-af0d-74ec8006df6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.634224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:04.635897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:04.645078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dde154-2dea-4825-af0d-74ec8006df6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:04.648505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:04.649490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:04.650391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-56dde154-2dea-4825-af0d-74ec8006df6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:04.651840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:04.652693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:04.653485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 279/560] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:04.654226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dde154-2dea-4825-af0d-74ec8006df6f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:04.656034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 282/561] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:04.663427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:04.720169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:04.779975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dde154-2dea-4825-af0d-74ec8006df6f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.784071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0cd4c-40a0-4b17-8307-00ac8513ecd1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.811115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:04.815676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.816302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.816585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.816858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.817546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:04.817846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:04.819299 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:04.823985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410714-de25-4c4f-af9f-65f898d9b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.825414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410714-de25-4c4f-af9f-65f898d9b178 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.825901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410714-de25-4c4f-af9f-65f898d9b178 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.826380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410714-de25-4c4f-af9f-65f898d9b178 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.827519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410714-de25-4c4f-af9f-65f898d9b178 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:04.828036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410714-de25-4c4f-af9f-65f898d9b178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:04.830042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410714-de25-4c4f-af9f-65f898d9b178 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:04.832281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 280/562] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:04.833354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:04.854300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 283/563] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:04.856006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03adcba-426a-472e-96a2-aa71e10d52dc None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.856413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03adcba-426a-472e-96a2-aa71e10d52dc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.856760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03adcba-426a-472e-96a2-aa71e10d52dc None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.858237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 284/564] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:04.858844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03adcba-426a-472e-96a2-aa71e10d52dc None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:04.947805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72dbb-d8ab-4b0c-9f9a-dedde4716000 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.958274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:04.976150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03adcba-426a-472e-96a2-aa71e10d52dc None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:04.983472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:04.984093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:04.984375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:04.984646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:04.985360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:04.985666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:04.987024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:04.995727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 281/565] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:04.996495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.014183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8d350-12eb-440e-a172-c5666e91a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.014823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8d350-12eb-440e-a172-c5666e91a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.015099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8d350-12eb-440e-a172-c5666e91a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.015393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8d350-12eb-440e-a172-c5666e91a0e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.022511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8d350-12eb-440e-a172-c5666e91a0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:05.024069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8d350-12eb-440e-a172-c5666e91a0e7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ccf8d350-12eb-440e-a172-c5666e91a0e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:05.035963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:05.036998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 285/566] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea144-6f73-4259-bad8-73d1143a35c2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.042970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea144-6f73-4259-bad8-73d1143a35c2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.043713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea144-6f73-4259-bad8-73d1143a35c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.057283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-547ea144-6f73-4259-bad8-73d1143a35c2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:05.058560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-547ea144-6f73-4259-bad8-73d1143a35c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:05.096136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ee469-f90f-4205-ac99-262513affbe2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.104772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:05.135482 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.136105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 286/567] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:05.136239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.136412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.136664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.137402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cd0f-d606-4d5d-922b-785191f92dd5 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.137672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cd0f-d606-4d5d-922b-785191f92dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.137950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201cd0f-d606-4d5d-922b-785191f92dd5 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.143465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 287/568] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:05.143465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201cd0f-d606-4d5d-922b-785191f92dd5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.153194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:05.154860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:05.171692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:05.172780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:05.173773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:05.173773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:05.173773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:05.173773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:05.173773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 282/569] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:05.174101 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.203333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:05.262345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201cd0f-d606-4d5d-922b-785191f92dd5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.280328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1a0b-ae4a-4347-b2a1-d9079476c2f4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.296692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896c90b-a39c-452f-83a7-58bb1d93331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.297340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c90b-a39c-452f-83a7-58bb1d93331c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.297629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c90b-a39c-452f-83a7-58bb1d93331c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.297906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c90b-a39c-452f-83a7-58bb1d93331c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.308528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896c90b-a39c-452f-83a7-58bb1d93331c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:05.309986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896c90b-a39c-452f-83a7-58bb1d93331c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:05.315924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.316550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.316843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.317115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.317867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:05.318173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:05.319623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b896c90b-a39c-452f-83a7-58bb1d93331c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:05.324858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:05.325919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:05.326808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:05.326808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:05.326808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:05.326808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:05.326808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 288/570] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:05.327283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606f49a-5e5e-4004-9d8e-6c7e3f52d905 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.327596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606f49a-5e5e-4004-9d8e-6c7e3f52d905 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.327879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606f49a-5e5e-4004-9d8e-6c7e3f52d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.335545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 283/571] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:05.336521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.346464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e606f49a-5e5e-4004-9d8e-6c7e3f52d905 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:05.347706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e606f49a-5e5e-4004-9d8e-6c7e3f52d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:05.369580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:05.420444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 289/572] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:05.421378 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606f49a-5e5e-4004-9d8e-6c7e3f52d905 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.424534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:05.441354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7bc94-06c9-4299-a239-158b944f9d39 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.476278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d8683-b49d-47b2-b30d-09700180bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.476925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d8683-b49d-47b2-b30d-09700180bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.477211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d8683-b49d-47b2-b30d-09700180bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.477484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d8683-b49d-47b2-b30d-09700180bbd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.488146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d8683-b49d-47b2-b30d-09700180bbd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f65d8683-b49d-47b2-b30d-09700180bbd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:05.494424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:05.495597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 284/573] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:05.496411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d8683-b49d-47b2-b30d-09700180bbd5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.545199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606f49a-5e5e-4004-9d8e-6c7e3f52d905 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.580378 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.580998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.581281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.581559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.582248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:05.582556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:05.583984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:05.595550 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 290/574] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:05.596338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.598605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d8683-b49d-47b2-b30d-09700180bbd5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.615258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:05.633479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.634083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.634368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.634647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.635344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:05.635687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:05.637075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:05.649397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 285/575] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:05.650232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.654380 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:05.704268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a21d3-9810-4aee-8215-e58cac5c2b95 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.742094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.742712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.742993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.743264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.744075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=f2434616a540474f948c821e18e1a112) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:05.744383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:05.745832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:05.752340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 291/576] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/role_assignments?user.id=f2434616a540474f948c821e18e1a112&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:05.753334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.753457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf43c7-74ca-4897-805e-f2377836996c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.807256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc64428-3038-4b40-98e3-cab1545333e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.807873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc64428-3038-4b40-98e3-cab1545333e0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.808156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc64428-3038-4b40-98e3-cab1545333e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.808432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc64428-3038-4b40-98e3-cab1545333e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.821706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc64428-3038-4b40-98e3-cab1545333e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-bbc64428-3038-4b40-98e3-cab1545333e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:05.827469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:05.828475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:05.829309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 286/577] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:05.830060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc64428-3038-4b40-98e3-cab1545333e0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.864191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:05.888073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf424c-cf39-4312-aedb-6a4ce7a2152a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.906016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:05.934481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.935115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.935438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.935707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:05.936427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:05.936741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:05.938126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:05.954380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 292/578] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:05.954380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:05.954629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc64428-3038-4b40-98e3-cab1545333e0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:05.992081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:05.993065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:05.993348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:05.993623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.001209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.002694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:06.015173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:06.016263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:06.017376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:06.017376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:06.017376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:06.017376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:06.017376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:06.017376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:06.017376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:06.017376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:06.019682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 287/579] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:06.021024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.070096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae589d69-557e-409c-b277-32bcae51e28c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.107109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.107806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.108092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.108370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.116126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.117562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:06.129565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:06.130499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:24:06.131968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:06.132495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744242-7199-491e-85c0-1cc4d54f843a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.135967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 293/580] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:06.136582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.139549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:06.157432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:06.170892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.171651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.171931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.172272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.173019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:06.173372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.174816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.185703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 288/581] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:06.186605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.263399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb7f99-77c0-4e81-ba45-29987705396a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.300975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040aec9-89f5-47ca-a11a-8b0bdce28a60 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.301950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.302702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.303017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.303517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.315093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.316603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:06.332261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:06.333396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:06.335007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:06.335007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:06.335007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:06.335007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:06.335007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 294/582] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:06.335007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.339424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.340061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.340347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.340624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.341866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:06.341866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.343151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.356495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 289/583] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:06.357323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.404510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:06.409301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:06.456804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6ed06-469d-42a2-8689-9eab319e7bae None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.470395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4cfe9-833e-40fd-8964-753cf4cc6204 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.495331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.496214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.496668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.497205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.498266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:06.498721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.500518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.505453 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.506104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.506421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.506693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.517288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.518528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.526457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 295/584] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:06.527486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:06.543933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:06.544934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:06.545805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:06.545805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:06.545805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:06.545805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:06.550860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 290/585] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:06.550860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.655232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca333f-ebe8-4430-867c-9e8477dbd6b3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.667693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:06.671940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:06.674715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9feade-07d7-4c02-b733-4c9a244517a3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.698478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.699112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.699817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.699817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.700515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:06.700821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.702263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.721385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 296/586] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:06.721385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.726204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8505-91a2-4b85-a9f0-196cd92ead56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.727256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8505-91a2-4b85-a9f0-196cd92ead56 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.727781 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8505-91a2-4b85-a9f0-196cd92ead56 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.728267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8505-91a2-4b85-a9f0-196cd92ead56 None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/4aa7374d435f497d9e9bdd3c5d9d2c7c/roles/b0731d356a6144c3a373a2085c88f855` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.746997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8505-91a2-4b85-a9f0-196cd92ead56 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=4aa7374d435f497d9e9bdd3c5d9d2c7c, role_id=b0731d356a6144c3a373a2085c88f855)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.748518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8505-91a2-4b85-a9f0-196cd92ead56 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.775417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 291/587] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:06 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/4aa7374d435f497d9e9bdd3c5d9d2c7c/roles/b0731d356a6144c3a373a2085c88f855 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:06.775417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8505-91a2-4b85-a9f0-196cd92ead56 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.858801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911aed7-45bf-4752-97ea-c858c7a4fbd2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.911094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.911891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.912266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.912520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8505-91a2-4b85-a9f0-196cd92ead56 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:06.912703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.927478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.929635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:06.954866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:06.955975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:06.956863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:06.956863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:06.956863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:06.956863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:06.956863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 297/588] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:06.957975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:06.970600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:06.971510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:06.971903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:06.972288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:06.973204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:06.973620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:06.975164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:06.989604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 292/589] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:06.990253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.000176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:07.006113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:07.104265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92eeb7-c113-40fb-92a8-54ac1b9d573e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.121396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15c441-17b7-4568-83a2-398067428871 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.148572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.149225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.149505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.149780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.158029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:07.159310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:07.172544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:07.173670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 298/590] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:07.174792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.181291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.182522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.183957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.184246 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.184957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:07.185265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:07.186644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:07.205156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 293/591] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:07.205997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.295304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:07.300383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:07.319884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79089-0a07-479e-b144-739a9b6eace3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.348812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d92257-204f-4841-89d4-71cbb268990c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.370993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.371777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.372126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.372472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.383068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:07.384672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:07.396292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.397277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.398260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.398713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:07.398819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:07.399723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:07.400632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 299/592] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:07.401209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.402742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:07.403241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:07.405215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:07.432666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 294/593] 10.222.0.71 () {56 vars in 1139 bytes} [Mon Aug 1 15:24:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:07.433524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.537154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65073e4a-f823-48a9-be11-fd505cecc6d8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.566832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38cb92-264a-4e2e-bd79-c80bbf5d84ed None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.582037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.583209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.583696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.584136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.594605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:07.597071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:07.599666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:07.610319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.611081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.611525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.611897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.612884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:07.613298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:07.614867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:07.616149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:07.617170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:07.618262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:07.618262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:07.618262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:07.618262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:07.618262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:07.618262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:07.618262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:07.618262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:07.621584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 300/594] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:07.622526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.626455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:07.644402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 295/595] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Aug 1 15:24:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:07.645438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.748844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb48d6-432b-4d18-ab0b-15e38031f7e7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.773759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27d6a7-e4ac-4446-875a-4bf16ad7cbf6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.794399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.795297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.796333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.796761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.811263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.812123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.812489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.812915 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.813578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:07.813864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:07.814265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:07.815529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:07.815930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:07.833648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:07.834799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:07.835923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:07.835923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:07.835923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:07.835923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:07.836189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 296/596] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:07.836981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.837807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 301/597] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:07.843411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.894892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:07.904852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:07.956369 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172bd0a-d756-42eb-82e0-2dc25f2534bb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.958293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108c9d-d6c9-42ca-9a88-21569106739d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:07.994962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a93d0-8eed-4429-a1ba-fd8493242557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.995706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a93d0-8eed-4429-a1ba-fd8493242557 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.995995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a93d0-8eed-4429-a1ba-fd8493242557 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.996278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a93d0-8eed-4429-a1ba-fd8493242557 None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/f03250eb151044619c0f720f315b8509/roles/b0731d356a6144c3a373a2085c88f855` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.996568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f37bad-d2fb-41eb-a775-6ccbd06aaed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:07.997219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37bad-d2fb-41eb-a775-6ccbd06aaed1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.997503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37bad-d2fb-41eb-a775-6ccbd06aaed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.997776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37bad-d2fb-41eb-a775-6ccbd06aaed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.010182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f37bad-d2fb-41eb-a775-6ccbd06aaed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.011763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f37bad-d2fb-41eb-a775-6ccbd06aaed1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.012540 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a93d0-8eed-4429-a1ba-fd8493242557 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=f03250eb151044619c0f720f315b8509, role_id=b0731d356a6144c3a373a2085c88f855)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.014127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a93d0-8eed-4429-a1ba-fd8493242557 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e9f37bad-d2fb-41eb-a775-6ccbd06aaed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:08.027971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:08.028992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:08.036793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:08.036793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:08.036793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:08.036793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:08.037020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 302/598] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:07 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/f03250eb151044619c0f720f315b8509/roles/b0731d356a6144c3a373a2085c88f855 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:24:08.037020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a93d0-8eed-4429-a1ba-fd8493242557 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.037153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 297/599] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:08.037153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fabbc-605c-4a25-a8a7-9dadb7a82fd2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.037153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fabbc-605c-4a25-a8a7-9dadb7a82fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.037153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fabbc-605c-4a25-a8a7-9dadb7a82fd2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.042042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 298/600] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:08.043061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fabbc-605c-4a25-a8a7-9dadb7a82fd2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.162551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a93d0-8eed-4429-a1ba-fd8493242557 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.171468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:08.185926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:08.197117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fabbc-605c-4a25-a8a7-9dadb7a82fd2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.204702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6def9-e53f-4f58-acfd-d3f173e672a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.205340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6def9-e53f-4f58-acfd-d3f173e672a0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.205629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6def9-e53f-4f58-acfd-d3f173e672a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.205907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6def9-e53f-4f58-acfd-d3f173e672a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.206608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6def9-e53f-4f58-acfd-d3f173e672a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:08.206919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6def9-e53f-4f58-acfd-d3f173e672a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.208338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6def9-e53f-4f58-acfd-d3f173e672a0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.222114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 303/601] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:08.223490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267d178-4178-4919-bc2a-7386a1aaa70f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.223784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267d178-4178-4919-bc2a-7386a1aaa70f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.224065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267d178-4178-4919-bc2a-7386a1aaa70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.245374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4267d178-4178-4919-bc2a-7386a1aaa70f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:08.246362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4267d178-4178-4919-bc2a-7386a1aaa70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:08.249240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.249881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.251062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.251597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.252334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:08.252643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.254063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.268673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 299/602] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:08.269598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.339543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 304/603] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:08.340905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267d178-4178-4919-bc2a-7386a1aaa70f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.403154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7347b-e604-49f2-98a8-91a077745651 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.446057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.446783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.447071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.447717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.455113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.456651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.464878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:08.473116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267d178-4178-4919-bc2a-7386a1aaa70f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:08.476165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:08.477041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:08.478111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 300/604] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:08.478728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.505071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:08.534806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.535434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.535725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.536001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.546811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.549009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:08.566325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:08.567268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:08.568197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:08.568197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:08.568197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:08.568197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:08.568197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:08.568197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:08.568197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:08.568197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:08.571468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 305/605] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:08.572911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.623891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd530-c676-4ab5-8b36-e2709f3f0007 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.674329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a302-2cb1-4125-8b48-ace3f085c062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.674991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a302-2cb1-4125-8b48-ace3f085c062 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.675273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a302-2cb1-4125-8b48-ace3f085c062 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.675583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a302-2cb1-4125-8b48-ace3f085c062 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.690529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789a302-2cb1-4125-8b48-ace3f085c062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-0789a302-2cb1-4125-8b48-ace3f085c062 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:08.697673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:08.698648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:08.699517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:08.704043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 301/606] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:08.704836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a302-2cb1-4125-8b48-ace3f085c062 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.708917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235a6f6-ce7d-4a2a-a169-c693398ae491 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.753440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.754096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.754437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.754719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.755500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:08.755816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.757519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.771305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 306/607] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:08.772711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.792448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:08.795036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:08.820191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a302-2cb1-4125-8b48-ace3f085c062 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.862737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.863949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.864418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.865158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.866124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:08.866612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.869039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.891256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 302/608] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:08.891256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.901057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdeb7d-8718-414f-a573-21247c3bf5ec None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.941211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.941835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.942155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.942432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.943149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:08.943489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.945484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.953937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 307/609] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:08.959172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:09.000209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d360d5-57ed-44ab-8c80-676333da60db None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:09.035847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad14ac7-d1a9-4b24-aa0e-567c6b3135a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:09.036522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14ac7-d1a9-4b24-aa0e-567c6b3135a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.036799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14ac7-d1a9-4b24-aa0e-567c6b3135a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.037086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14ac7-d1a9-4b24-aa0e-567c6b3135a4 None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/1a1f3e1faeba451488854da4236359ac/roles/b0731d356a6144c3a373a2085c88f855` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.041970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:09.046924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:09.054975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad14ac7-d1a9-4b24-aa0e-567c6b3135a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=1a1f3e1faeba451488854da4236359ac, role_id=b0731d356a6144c3a373a2085c88f855)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:09.056544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad14ac7-d1a9-4b24-aa0e-567c6b3135a4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:09.074644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672045-a760-4f15-a053-c6f62bde86c5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:09.075461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 303/610] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:08 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/1a1f3e1faeba451488854da4236359ac/roles/b0731d356a6144c3a373a2085c88f855 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:09.078481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ac1b-e141-4a2e-9831-883cf8ca1117 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.078976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ac1b-e141-4a2e-9831-883cf8ca1117 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.079408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ac1b-e141-4a2e-9831-883cf8ca1117 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.081502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 304/611] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:09.082512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ac1b-e141-4a2e-9831-883cf8ca1117 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:09.125057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ae8a6-13c5-4d92-b803-b32ef4fad186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:09.125912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ae8a6-13c5-4d92-b803-b32ef4fad186 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.126204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ae8a6-13c5-4d92-b803-b32ef4fad186 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.126489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ae8a6-13c5-4d92-b803-b32ef4fad186 None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/79a4e12e752446f296569df09f2ac824/roles/b0731d356a6144c3a373a2085c88f855` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.155205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ae8a6-13c5-4d92-b803-b32ef4fad186 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=79a4e12e752446f296569df09f2ac824, role_id=b0731d356a6144c3a373a2085c88f855)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:09.157784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ae8a6-13c5-4d92-b803-b32ef4fad186 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:09.176458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 308/612] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:08 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/79a4e12e752446f296569df09f2ac824/roles/b0731d356a6144c3a373a2085c88f855 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:09.179130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6b9dc-d201-4703-a45b-ca20c65af6ef None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.179673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6b9dc-d201-4703-a45b-ca20c65af6ef None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.180134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6b9dc-d201-4703-a45b-ca20c65af6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.204378 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ddd6b9dc-d201-4703-a45b-ca20c65af6ef None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:09.206140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ddd6b9dc-d201-4703-a45b-ca20c65af6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:09.292353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ac1b-e141-4a2e-9831-883cf8ca1117 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:09.297646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 309/613] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:09.335556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6b9dc-d201-4703-a45b-ca20c65af6ef None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:09.350026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:09.350768 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.351051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.351323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.371325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:09.372902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:09.395187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:09.396362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:09.397686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:09.397686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:09.397686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:09.397686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:09.399315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 305/614] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:09.404814 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:09.422426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:09.475706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:09.475901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6b9dc-d201-4703-a45b-ca20c65af6ef None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:09.542490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a7e75-fa60-4af9-915a-b7ac1fb39bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:09.543310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a7e75-fa60-4af9-915a-b7ac1fb39bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.543615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a7e75-fa60-4af9-915a-b7ac1fb39bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.543887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a7e75-fa60-4af9-915a-b7ac1fb39bd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.545744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22558e53-af22-45b0-ad9c-d0916b3e9571 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:09.579492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a7e75-fa60-4af9-915a-b7ac1fb39bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-324a7e75-fa60-4af9-915a-b7ac1fb39bd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:09.582713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:09.583689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:09.584627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:09.587155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 310/615] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:09.594303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a7e75-fa60-4af9-915a-b7ac1fb39bd4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:09.595803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:09.596445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.596725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.596998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.597697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:09.598000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:09.599401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:09.625250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 306/616] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:09.637951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:09.764067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a7e75-fa60-4af9-915a-b7ac1fb39bd4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:09.782711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:09.816921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:09.817575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.817889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.818164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.819532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:09.819850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:09.821239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:09.835400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 311/617] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:09.841548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:09.848754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dffe7b-e142-4e0d-bbfd-65ac3df0642f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:09.850500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:09.890444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:09.891099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:09.891399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:09.891798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:09.901044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:09.902817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:09.915865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:09.916997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:09.918075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 307/618] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:09.923422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.022323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaebdb0-d28d-4c73-bba1-e76d4213cf16 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.060038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.060789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.061145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.061493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.074955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.076791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:10.095270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:10.096397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:10.097603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:10.097603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:10.097603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:10.097603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:10.098553 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 312/619] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:10.104175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.143746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:10.216525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a2b58-7fb4-4356-8378-8233ecc29b6f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.237094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7910-0845-4949-b027-a673fa72afdf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.270902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.271855 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.273410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.273988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.275929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:10.277109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.279232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.289217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.290398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.290825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.291243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.292325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:10.292776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.294410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.319869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 313/620] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:10.326370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.342956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 308/621] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Aug 1 15:24:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:10.348539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.393822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:10.497526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:10.511388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2529ab-88de-4415-9869-09d8f6afc687 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.530650 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6e72-d8b6-44de-94cd-de6505d663db None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.567667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da45c-0847-4f52-9be5-a1b65a9280ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.568845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da45c-0847-4f52-9be5-a1b65a9280ca None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.569000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da45c-0847-4f52-9be5-a1b65a9280ca None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.569250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da45c-0847-4f52-9be5-a1b65a9280ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.585030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da45c-0847-4f52-9be5-a1b65a9280ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.589708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da45c-0847-4f52-9be5-a1b65a9280ca None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.594338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54b116-35ad-4c40-acea-e870401ecc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.595234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b116-35ad-4c40-acea-e870401ecc27 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.595761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b116-35ad-4c40-acea-e870401ecc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.596196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b116-35ad-4c40-acea-e870401ecc27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.608351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54b116-35ad-4c40-acea-e870401ecc27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.609889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54b116-35ad-4c40-acea-e870401ecc27 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c39da45c-0847-4f52-9be5-a1b65a9280ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:10.611452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:10.613124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:10.614924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:10.624148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 314/622] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:10.626552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187af9d-b245-4329-a75d-9c4fc09be0c9 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.626883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187af9d-b245-4329-a75d-9c4fc09be0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.627341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187af9d-b245-4329-a75d-9c4fc09be0c9 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.628871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 315/623] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:10.629412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187af9d-b245-4329-a75d-9c4fc09be0c9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4f54b116-35ad-4c40-acea-e870401ecc27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:10.637283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:10.638230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:10.639090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:10.639090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:10.639090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:10.639090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:10.639090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 309/624] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:10.645086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db25398-5b3c-4d63-886a-ab5a757dc78a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.645371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db25398-5b3c-4d63-886a-ab5a757dc78a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.645671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db25398-5b3c-4d63-886a-ab5a757dc78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.665454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6db25398-5b3c-4d63-886a-ab5a757dc78a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:10.666632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6db25398-5b3c-4d63-886a-ab5a757dc78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:10.737747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:10.745841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 310/625] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:10.746986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db25398-5b3c-4d63-886a-ab5a757dc78a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.779436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187af9d-b245-4329-a75d-9c4fc09be0c9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.818456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.819844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.820047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.820382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.821237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:10.821575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.823084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.847443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 316/626] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:10.847443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.861017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:10.876533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db25398-5b3c-4d63-886a-ab5a757dc78a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.914466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.915329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.915659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.915937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.916696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:10.916926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.918458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.936791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 311/627] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:10.937916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.960529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898328c2-b6c9-4eeb-a800-141b8d91571a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.997090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd5d4-f461-4643-97b7-894a4677d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.998112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd5d4-f461-4643-97b7-894a4677d75b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.998704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd5d4-f461-4643-97b7-894a4677d75b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.999202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd5d4-f461-4643-97b7-894a4677d75b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.004995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:11.014255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fd5d4-f461-4643-97b7-894a4677d75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-1c2fd5d4-f461-4643-97b7-894a4677d75b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:11.019879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:11.020827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:11.021650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:11.025199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 317/628] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:11.026361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd5d4-f461-4643-97b7-894a4677d75b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:11.054055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b8e2-fa72-4d1f-8c51-468ee1a72fb0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:11.093216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a645f-972f-411d-8213-93eedad4728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:11.093868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a645f-972f-411d-8213-93eedad4728e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.094388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a645f-972f-411d-8213-93eedad4728e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.094498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a645f-972f-411d-8213-93eedad4728e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.106248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:11.142452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd5d4-f461-4643-97b7-894a4677d75b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:11.181844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:11.182956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.183558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.184051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.193433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:11.195931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:11.209089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:11.210625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:11.211536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:11.211536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:11.211536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:11.211536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:11.211536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:11.211536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:11.211536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:11.211536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:11.213558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a645f-972f-411d-8213-93eedad4728e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:11.214284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 318/629] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:11.215271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a645f-972f-411d-8213-93eedad4728e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:11.215513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:11.296438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:11.340163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4d60b-5aee-439d-9017-6c84835b0ced None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:11.352612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 312/630] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:11.352612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a645f-972f-411d-8213-93eedad4728e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:11.376613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:11.384437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:11.385445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.385961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.386493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.387451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:11.387973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:11.389688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:11.399675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 319/631] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:11.400904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:11.476498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a645f-972f-411d-8213-93eedad4728e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:11.510560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ca5d7-7b07-4d85-894d-b810ce1fd7df None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:11.526874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:11.527544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.527828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.528104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.528872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:11.529181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:11.530634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:11.549211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 313/632] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:11.549211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:11.568968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:11.570373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.571294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:11.571774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.572263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.588170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:11.589819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:11.610723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:11.611803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:11.618161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:11.618161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:11.618161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:11.618161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:11.618161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 320/633] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:11.618161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:11.673550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fdf73-727a-427b-bfc0-e3f47beec72d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:11.689760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:11.718677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07803d7f-e9b3-4c42-8132-a7c1946a48c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:11.719489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07803d7f-e9b3-4c42-8132-a7c1946a48c7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.719819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07803d7f-e9b3-4c42-8132-a7c1946a48c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.720130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07803d7f-e9b3-4c42-8132-a7c1946a48c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.731752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07803d7f-e9b3-4c42-8132-a7c1946a48c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:11.733240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07803d7f-e9b3-4c42-8132-a7c1946a48c7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:11.750137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ad1d-c5a8-4dc4-91e7-804c5a19b802 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-07803d7f-e9b3-4c42-8132-a7c1946a48c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:11.750438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:11.758664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 314/634] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd136ab8-2bbb-48a4-8dff-a0f5704b1445 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd136ab8-2bbb-48a4-8dff-a0f5704b1445 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd136ab8-2bbb-48a4-8dff-a0f5704b1445 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.760514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 315/635] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:11.761403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd136ab8-2bbb-48a4-8dff-a0f5704b1445 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:11.799350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6286aa-e9ef-4aca-9843-6edbec9a3a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:11.800059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6286aa-e9ef-4aca-9843-6edbec9a3a51 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.800343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6286aa-e9ef-4aca-9843-6edbec9a3a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.800618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6286aa-e9ef-4aca-9843-6edbec9a3a51 None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/f2434616a540474f948c821e18e1a112/roles/b0731d356a6144c3a373a2085c88f855` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.818227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6286aa-e9ef-4aca-9843-6edbec9a3a51 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=f2434616a540474f948c821e18e1a112, role_id=b0731d356a6144c3a373a2085c88f855)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:11.820295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6286aa-e9ef-4aca-9843-6edbec9a3a51 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:11.845105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 321/636] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:11 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/f2434616a540474f948c821e18e1a112/roles/b0731d356a6144c3a373a2085c88f855 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:11.846835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327905-9f6d-4c47-8d75-d406d227e008 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.847265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327905-9f6d-4c47-8d75-d406d227e008 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.847823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327905-9f6d-4c47-8d75-d406d227e008 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.849676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 322/637] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:11.851260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327905-9f6d-4c47-8d75-d406d227e008 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:11.872108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:11.926795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd136ab8-2bbb-48a4-8dff-a0f5704b1445 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:11.979025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57029a-e096-4679-9a41-b75f98ca22c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:11.979025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57029a-e096-4679-9a41-b75f98ca22c9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:11.979025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57029a-e096-4679-9a41-b75f98ca22c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:11.979025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57029a-e096-4679-9a41-b75f98ca22c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:11.979651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57029a-e096-4679-9a41-b75f98ca22c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:11.979651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57029a-e096-4679-9a41-b75f98ca22c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:11.979907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57029a-e096-4679-9a41-b75f98ca22c9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:11.999749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 316/638] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:12.000988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb0e6-4eb6-4776-afce-86a66214df2a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.001435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb0e6-4eb6-4776-afce-86a66214df2a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.001708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb0e6-4eb6-4776-afce-86a66214df2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.014290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.024501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6bfcb0e6-4eb6-4776-afce-86a66214df2a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:12.025709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6bfcb0e6-4eb6-4776-afce-86a66214df2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:12.028079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327905-9f6d-4c47-8d75-d406d227e008 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.082708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107415e-2d2d-4f60-8068-63a3ca471267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.083973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107415e-2d2d-4f60-8068-63a3ca471267 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.084485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107415e-2d2d-4f60-8068-63a3ca471267 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.084782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107415e-2d2d-4f60-8068-63a3ca471267 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.085966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107415e-2d2d-4f60-8068-63a3ca471267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:12.085966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107415e-2d2d-4f60-8068-63a3ca471267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.088288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107415e-2d2d-4f60-8068-63a3ca471267 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.104671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 323/639] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:12.110441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effa338-3044-4be2-a537-568790f8d813 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.110798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effa338-3044-4be2-a537-568790f8d813 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.111050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effa338-3044-4be2-a537-568790f8d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.129500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 317/640] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:12.129500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb0e6-4eb6-4776-afce-86a66214df2a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.139633 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2effa338-3044-4be2-a537-568790f8d813 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:12.141389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2effa338-3044-4be2-a537-568790f8d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:12.214296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.246237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 324/641] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:12.247340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effa338-3044-4be2-a537-568790f8d813 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.270249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb0e6-4eb6-4776-afce-86a66214df2a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.327964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.327964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.327964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.327964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.336744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.338215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:12.352238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:12.353303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:12.354226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:12.354226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:12.354226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:12.354226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:12.354226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:12.354226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:12.354226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:12.354226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:12.358863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 318/642] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:12.359780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.390501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.417204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effa338-3044-4be2-a537-568790f8d813 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.472138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.472838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.473131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.473470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.481874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.483362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.503511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161daaef-fd30-480d-a7b0-a8465ed28fbc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:12.504101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:12.505013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 325/643] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:12.506568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.530983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.549762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8c5bb-1eb7-4b77-b014-59166bf9247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.550407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c5bb-1eb7-4b77-b014-59166bf9247e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.550687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c5bb-1eb7-4b77-b014-59166bf9247e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.550958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c5bb-1eb7-4b77-b014-59166bf9247e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.565608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8c5bb-1eb7-4b77-b014-59166bf9247e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-73c8c5bb-1eb7-4b77-b014-59166bf9247e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:12.571643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:12.572571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:12.573475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 319/644] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:12.574279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8c5bb-1eb7-4b77-b014-59166bf9247e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.642460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a6c0c-648c-47aa-bdeb-cc3c1639ffb4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.689222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae629d-f2e5-4992-9a15-40b24d563796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.689439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8c5bb-1eb7-4b77-b014-59166bf9247e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.690135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae629d-f2e5-4992-9a15-40b24d563796 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.690581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae629d-f2e5-4992-9a15-40b24d563796 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.690979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae629d-f2e5-4992-9a15-40b24d563796 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.707236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae629d-f2e5-4992-9a15-40b24d563796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-1cae629d-f2e5-4992-9a15-40b24d563796 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:12.715712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:12.716671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:12.717485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 326/645] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:12.718638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae629d-f2e5-4992-9a15-40b24d563796 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.723177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.732365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.733240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.733524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.733803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.734550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:12.734862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.736343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.748903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 320/646] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:12.749711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.798795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.849459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae629d-f2e5-4992-9a15-40b24d563796 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.877609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157e1a-2797-4172-9bb9-3c9f4cd0bec0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.888015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.888890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.889397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.889888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.890763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:12.891141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.892874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.914136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 327/647] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:12.915647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.925463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.926088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.926369 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.926640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.927469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:12.928011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.929662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.946520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 321/648] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:12.946520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.999129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.043523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6002-3644-4477-89ad-4194cbb2d6a4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.061624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183106a-f36b-49c7-bcbb-ccf22235a467 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.063594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.078362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.078995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.079280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.079594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.080312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:13.080617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.082029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.090789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 328/649] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:13.091622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.110639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.111545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.112169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.112608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.113705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:13.114177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.115966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.132050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 322/650] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/role_assignments?user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:13.133074 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.271463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055b66-c197-40c5-8ddf-512ca13c9bbf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.280410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd0027-5bab-4680-b04f-2a9278a3c486 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.306098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.319687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d5feb-8cde-401b-b3ba-984f9c791412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.321238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5feb-8cde-401b-b3ba-984f9c791412 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.321238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5feb-8cde-401b-b3ba-984f9c791412 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.321238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5feb-8cde-401b-b3ba-984f9c791412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.323905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.324728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.325244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.325470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.340219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.341691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:13.357087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:13.358020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:13.359119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:13.359119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:13.359119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:13.359119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:13.359119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 323/651] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:13.359119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.386037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.424582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d5feb-8cde-401b-b3ba-984f9c791412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.426377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d5feb-8cde-401b-b3ba-984f9c791412 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.497684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940feee5-ec46-4a08-bd32-e1d759a922cc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.553774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 329/652] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:13.553774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d5feb-8cde-401b-b3ba-984f9c791412 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.557677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.558672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.559174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.559672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.576156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.578661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.581680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:13.600812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:13.602300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:13.603580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:13.603580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:13.603580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:13.603580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:13.605776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 324/653] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:13.607405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.700803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d5feb-8cde-401b-b3ba-984f9c791412 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.706958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.750294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5be5fb-a26a-47d6-a4b3-a2714cf129b3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.751472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.752559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.753059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.754411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.755401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:13.755866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.757452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.774728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 330/654] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:13.775837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.795241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.796107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.796496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.797040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.809012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.810589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:13.827249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:13.828401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:13.829531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:13.829531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:13.829531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:13.829531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:13.836332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 325/655] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:13.837412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.893163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.917245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97f171-3f15-4f15-bb07-eeca19cebb98 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.958211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4db1-7225-42da-bfa0-30f73b0be17d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.963440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.964073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.964351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.964624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.965313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:13.965615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.967024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.985458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 331/656] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:13.985458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.988131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:14.005514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866240f6-e150-46c9-a2a8-9667fb2890d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.006169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866240f6-e150-46c9-a2a8-9667fb2890d5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.006485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866240f6-e150-46c9-a2a8-9667fb2890d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.006766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866240f6-e150-46c9-a2a8-9667fb2890d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.014891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866240f6-e150-46c9-a2a8-9667fb2890d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:14.016391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866240f6-e150-46c9-a2a8-9667fb2890d5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-866240f6-e150-46c9-a2a8-9667fb2890d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:14.028745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:14.029723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:14.030630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 326/657] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:14.031207 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75c66a-8815-4157-95a2-5e94b5d0cf43 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.031630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75c66a-8815-4157-95a2-5e94b5d0cf43 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.031630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75c66a-8815-4157-95a2-5e94b5d0cf43 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.033118 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 327/658] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:14.033820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75c66a-8815-4157-95a2-5e94b5d0cf43 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.111001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15ef8f-b46c-4853-a3c0-b387a8cfa47f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:14.149837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75c66a-8815-4157-95a2-5e94b5d0cf43 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:14.154863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.155522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.155809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.156088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.156787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:14.157096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:14.158541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:14.176166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 332/659] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:14.176166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.181095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:14.194434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51abf7-1ef9-49f3-906b-84fc96a96443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.195083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51abf7-1ef9-49f3-906b-84fc96a96443 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.195360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51abf7-1ef9-49f3-906b-84fc96a96443 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.195661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51abf7-1ef9-49f3-906b-84fc96a96443 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.203393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51abf7-1ef9-49f3-906b-84fc96a96443 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:14.205090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51abf7-1ef9-49f3-906b-84fc96a96443 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7f51abf7-1ef9-49f3-906b-84fc96a96443 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:14.217960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:14.218931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:14.219882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 328/660] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:14.221061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408552f5-3d68-4c13-b9c1-d2b8f7762c2f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.221061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408552f5-3d68-4c13-b9c1-d2b8f7762c2f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.221212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408552f5-3d68-4c13-b9c1-d2b8f7762c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.245255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-408552f5-3d68-4c13-b9c1-d2b8f7762c2f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:14.245255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-408552f5-3d68-4c13-b9c1-d2b8f7762c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:14.299665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61095e-9ad4-40c2-9c36-9681f6db414e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:14.303494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:14.340899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.351449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.351680 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 329/661] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:14.351777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.351777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.351777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:14.352019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408552f5-3d68-4c13-b9c1-d2b8f7762c2f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.352109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:14.352109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:14.366158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 333/662] 10.222.0.71 () {56 vars in 1139 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:14.366950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.442776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:14.477337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408552f5-3d68-4c13-b9c1-d2b8f7762c2f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:14.490456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b37f1-723c-4f39-82e1-bf752c8df543 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:14.515780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.516533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.516888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.517343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.524124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:14.525587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:14.528694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.529314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.529596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.529869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.530658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:14.530968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:14.532434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:14.537166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:14.538131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:14.539005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:14.539005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:14.539005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:14.539005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:14.539005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:14.539005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:14.539005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:14.539005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:14.543394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 330/663] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:14.544321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.552976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 334/664] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:14.554250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.586444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:14.677560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739572ac-6fb4-4db3-a362-d1ebc843f6d2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:14.678935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42d93a-00b0-403c-85d3-a999eeb2de40 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:14.704314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:14.723104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67e90e-3850-4ebe-8dd5-a8363cc2e2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.723313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0ab2b-2ea3-4772-b170-0c7d22ce5fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.723820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e90e-3850-4ebe-8dd5-a8363cc2e2aa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.724104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e90e-3850-4ebe-8dd5-a8363cc2e2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.724373 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0ab2b-2ea3-4772-b170-0c7d22ce5fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.724480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e90e-3850-4ebe-8dd5-a8363cc2e2aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.724785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0ab2b-2ea3-4772-b170-0c7d22ce5fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.725074 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0ab2b-2ea3-4772-b170-0c7d22ce5fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.738131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67e90e-3850-4ebe-8dd5-a8363cc2e2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5e67e90e-3850-4ebe-8dd5-a8363cc2e2aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:14.745871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:14.746984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:14.748061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:14.751178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 335/665] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:14.752648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67e90e-3850-4ebe-8dd5-a8363cc2e2aa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.807177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0ab2b-2ea3-4772-b170-0c7d22ce5fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:14.808660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0ab2b-2ea3-4772-b170-0c7d22ce5fa4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:14.844575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:14.885024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67e90e-3850-4ebe-8dd5-a8363cc2e2aa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:14.925444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:14.926074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:14.926358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:14.926632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:14.927407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:14.927765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:14.933803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 331/666] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:14.933957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:14.934039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0ab2b-2ea3-4772-b170-0c7d22ce5fa4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.941975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 336/667] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:14.942664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:14.999867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:15.059838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0ab2b-2ea3-4772-b170-0c7d22ce5fa4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.071830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa007-0b93-44dd-8302-fc4332f9e1f8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.089984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:15.096709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b459c0-23fa-4ccc-ac44-dba68f0e1749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.097391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b459c0-23fa-4ccc-ac44-dba68f0e1749 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.097662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b459c0-23fa-4ccc-ac44-dba68f0e1749 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.097890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b459c0-23fa-4ccc-ac44-dba68f0e1749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.112766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.113421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.113752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.114073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.114793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:15.115099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.116693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.126323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 337/668] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:15.127157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:15.182147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b459c0-23fa-4ccc-ac44-dba68f0e1749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.183538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b459c0-23fa-4ccc-ac44-dba68f0e1749 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.252501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7590f14-a47c-4910-82fc-e3cca7c58ce2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.255899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:15.300714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 332/669] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:15.301573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b459c0-23fa-4ccc-ac44-dba68f0e1749 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:15.309934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.310590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.310869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.311143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.323538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.324981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.337377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:15.341307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:15.342407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:15.343281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:15.343281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:15.343281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:15.343281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:15.343281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 338/670] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:15.343606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:15.415914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b459c0-23fa-4ccc-ac44-dba68f0e1749 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.452203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.452733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.453012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.453281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.454055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=f03250eb151044619c0f720f315b8509) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:15.454359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.455586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499d75-1b47-4eb3-b3c9-853e5dc8702d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.455886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.461799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 333/671] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/role_assignments?user.id=f03250eb151044619c0f720f315b8509&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:15.462554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:15.493008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.494001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.494287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.494568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.507171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.508752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:15.525545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:15.526510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:15.528102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:15.528102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:15.528102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:15.528102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:15.528102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 339/672] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:15.528102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:15.541858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:15.601993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:15.612689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0fe43-6ebf-4cd1-bf1c-719e877b1b50 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.667758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61643b3-e466-4a95-a1c1-8401040dcfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.668414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61643b3-e466-4a95-a1c1-8401040dcfed None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.668696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61643b3-e466-4a95-a1c1-8401040dcfed None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.668971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61643b3-e466-4a95-a1c1-8401040dcfed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.676157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568fded-9571-4c31-a4b9-0e328f2aa731 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.684594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61643b3-e466-4a95-a1c1-8401040dcfed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.687831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61643b3-e466-4a95-a1c1-8401040dcfed None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a61643b3-e466-4a95-a1c1-8401040dcfed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:15.704785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:15.706714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:15.708227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:15.708227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:15.708227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:15.708227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:15.708227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 334/673] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:15.708227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d77bf5-bffb-4641-9799-af59ac3b71ec None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.708642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d77bf5-bffb-4641-9799-af59ac3b71ec None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.708767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d77bf5-bffb-4641-9799-af59ac3b71ec None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.710616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 335/674] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:15.712622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d77bf5-bffb-4641-9799-af59ac3b71ec None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:15.733712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.734506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.734648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.734913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.735681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:15.736180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.737741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.754761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 340/675] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:15.755987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:15.855895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:15.873331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d77bf5-bffb-4641-9799-af59ac3b71ec None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.899896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9cb5e-7c8b-415c-96f5-17bdf61c5f7b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:15.913063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74832ce6-0d1f-4935-9460-84aeebea458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.913740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832ce6-0d1f-4935-9460-84aeebea458f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.914020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832ce6-0d1f-4935-9460-84aeebea458f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.914342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832ce6-0d1f-4935-9460-84aeebea458f None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.915292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74832ce6-0d1f-4935-9460-84aeebea458f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:15.915631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74832ce6-0d1f-4935-9460-84aeebea458f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.916993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74832ce6-0d1f-4935-9460-84aeebea458f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.932144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 336/676] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:15.939316 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:15.940246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.940519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.940803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.941478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:15.941781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:15.942833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704caa-d0ae-45be-a292-0cc732e9146b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.943152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:15.943259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704caa-d0ae-45be-a292-0cc732e9146b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.943608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704caa-d0ae-45be-a292-0cc732e9146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.955933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 341/677] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:15.960757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:15.963006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-19704caa-d0ae-45be-a292-0cc732e9146b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:15.964253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-19704caa-d0ae-45be-a292-0cc732e9146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:15.966831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.052012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 337/678] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:16.052012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704caa-d0ae-45be-a292-0cc732e9146b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.095077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43d32-d285-4ff8-a47d-d9597f2b8176 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.128024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.138447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.139182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.139488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.139945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.149487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.151051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:16.169521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:16.170479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:16.171342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:16.171342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:16.171342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:16.171342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:16.171342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:16.171342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:16.171342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:16.171342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:16.171885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 342/679] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:16.172819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.190096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704caa-d0ae-45be-a292-0cc732e9146b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.243198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.244327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.245005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.245485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.257791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.259292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.261963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:16.276933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:16.277968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:16.278907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:16.282894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 338/680] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:16.283820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.307885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06c0f-51fd-4bb6-911b-301e8cb32ee0 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.353911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.354835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.355122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.355420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.362960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.364604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:16.377940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:16.378897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:16.379805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 343/681] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:16.380283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.415987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6443477-e906-479a-b0a7-de8ac1d3f4af None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.455046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.460347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3800889-8ffb-4623-905d-368a0f3aab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.460990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800889-8ffb-4623-905d-368a0f3aab15 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.461268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800889-8ffb-4623-905d-368a0f3aab15 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.461540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800889-8ffb-4623-905d-368a0f3aab15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.472233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3800889-8ffb-4623-905d-368a0f3aab15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e3800889-8ffb-4623-905d-368a0f3aab15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:16.477602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:16.478513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:16.479338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 339/682] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:16.480098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3800889-8ffb-4623-905d-368a0f3aab15 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.528150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c13dd-2694-40d7-9fc3-0159c40874a9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.546543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.565569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.566201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.566480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.566760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.567541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:16.567853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.570048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.589087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 344/683] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:16.589087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.600391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3800889-8ffb-4623-905d-368a0f3aab15 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.638467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.639096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.639391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.639687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.640491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:16.640821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.642901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.661462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 340/684] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:16.662291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.708799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca12ac2-9a0b-4c82-806c-2d167084e1a1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.719597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.750906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.751629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.751882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.752158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.753287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:16.753413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.754800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.773081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 345/685] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:16.773081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.779727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d03fb-b46a-4aec-a23a-20790f9d4d6f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.797787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.819922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.820631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.820984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.821330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.822147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:16.822550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.824047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.837462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 341/686] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:16.837462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.885030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482f13-2c77-42ea-a1e2-b83e0aa25c19 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.003973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.005014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.005303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.005579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.007237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=1a1f3e1faeba451488854da4236359ac) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:17.007591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.009806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.028719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 346/687] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/role_assignments?user.id=1a1f3e1faeba451488854da4236359ac&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:17.029393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.065524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e798-9c0c-47e9-9158-47d25e40bf3f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.070319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.121550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843cf30-941c-4321-a28f-c926096e35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.122479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843cf30-941c-4321-a28f-c926096e35cc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.122945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843cf30-941c-4321-a28f-c926096e35cc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.123367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843cf30-941c-4321-a28f-c926096e35cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.182693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.212554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843cf30-941c-4321-a28f-c926096e35cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.214811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843cf30-941c-4321-a28f-c926096e35cc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.294598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57859448-2127-4f4b-979b-763b06f88170 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.344981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.345756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.346035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.346308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.349264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=79a4e12e752446f296569df09f2ac824) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:17.349264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.349805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.358864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 347/688] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/role_assignments?user.id=79a4e12e752446f296569df09f2ac824&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:17.359721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.370669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 342/689] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:17.378511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843cf30-941c-4321-a28f-c926096e35cc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.482041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.512854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.520000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843cf30-941c-4321-a28f-c926096e35cc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.528847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09febf-ab3d-40cb-9c05-09cad5f050e1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.586837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.587672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.587962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.588241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.593559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.594471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.595232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.595947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.602900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.604411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.610042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.611716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:17.626023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:17.627232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:17.629143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:17.629143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:17.629143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:17.629143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:17.629143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 343/690] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:17.632473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:17.633430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:17.634406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:17.634406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:17.634406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:17.634406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:17.634626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.636447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 348/691] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:17.642068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.765541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a68eb-b12f-4f45-94bd-c4068a9df4b6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.776386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6580f-54d8-4bd1-b7e7-b7e4f4920ca4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.799661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.813666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea4c48-bcdd-499d-b39a-30deb778682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.814299 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4c48-bcdd-499d-b39a-30deb778682b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.814583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4c48-bcdd-499d-b39a-30deb778682b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.814858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4c48-bcdd-499d-b39a-30deb778682b None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.815591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea4c48-bcdd-499d-b39a-30deb778682b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:17.815901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea4c48-bcdd-499d-b39a-30deb778682b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.817291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea4c48-bcdd-499d-b39a-30deb778682b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.824595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.826174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.826683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.827154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.828585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:17.829491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.835409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 344/692] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:17.835409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f6c1-1473-4190-bf1d-24d6b328e0a4 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.835409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f6c1-1473-4190-bf1d-24d6b328e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.835409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f6c1-1473-4190-bf1d-24d6b328e0a4 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.836528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.839461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 345/693] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:17.841171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedd932-6bd4-41ea-90c7-2ba9ec636d28 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.841516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedd932-6bd4-41ea-90c7-2ba9ec636d28 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.841803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedd932-6bd4-41ea-90c7-2ba9ec636d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.854431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 349/694] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:17.856349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.862574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-eeedd932-6bd4-41ea-90c7-2ba9ec636d28 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:17.863881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-eeedd932-6bd4-41ea-90c7-2ba9ec636d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:17.868786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.947604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 346/695] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:17.948630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedd932-6bd4-41ea-90c7-2ba9ec636d28 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.998229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ae06c-33d8-4039-9deb-9f60f7c10d38 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.038896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.039717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.040301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.040655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.048870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.050455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:18.064410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:18.065360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:18.066223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:18.066223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:18.066223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:18.066223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:18.066223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:18.066223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:18.066223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:18.066223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:18.070882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 350/696] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:18.071989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:18.104570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedd932-6bd4-41ea-90c7-2ba9ec636d28 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.134446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:18.151524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:18.156621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.158755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.159284 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.159784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.170169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.172901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:18.191201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:18.192201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:18.193132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:18.193697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76551ef-e08f-4ea7-8e11-933acffa5dd2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.196399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 347/697] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:18.197356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:18.232427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.233385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.233726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.234169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.248838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.250428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:18.270269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:18.271467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:18.272503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:18.272503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:18.272503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:18.272503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:18.274710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 351/698] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:18.277943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:18.345022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747587-6a66-46a0-8f07-302d9e6018c2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.404560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.405622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.406450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.406881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.408327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:18.408928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.411825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.421777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add6904-7561-4e1c-921d-26467fb77c98 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.432880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 348/699] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:18.433872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:18.459932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:18.467797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.468488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.468958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.470118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.470946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:18.471262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.472908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.492443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:18.494016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 352/700] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:24:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:18.495238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:18.560879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8850b7-9a3c-4d2b-bc01-c7f9e023b797 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.603009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.604132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.604647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.605149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.606070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:18.606599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.608213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.612504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65934-3e18-43e3-bcdb-0caf95966137 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.622165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 349/701] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:18.623411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:18.651508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.652192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.652424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.652705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.653501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=f2434616a540474f948c821e18e1a112) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:18.653815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.655324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.663298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 353/702] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:18 2022] GET /identity/v3/role_assignments?user.id=f2434616a540474f948c821e18e1a112&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:18.664181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:18.720352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:18.743204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:18.747555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a62f3-6e11-4532-86d6-ab7aa68731b0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.790646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620245-39e1-4070-985f-581be288e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.791776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620245-39e1-4070-985f-581be288e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.792159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7beb37-9b71-4ee3-b57c-512b21f720ec None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.792909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620245-39e1-4070-985f-581be288e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.793417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620245-39e1-4070-985f-581be288e1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.836440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e9506-26b4-4e1c-88b1-fa796e10b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.837083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e9506-26b4-4e1c-88b1-fa796e10b255 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.837411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e9506-26b4-4e1c-88b1-fa796e10b255 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.837691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e9506-26b4-4e1c-88b1-fa796e10b255 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.838460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e9506-26b4-4e1c-88b1-fa796e10b255 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.840463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e9506-26b4-4e1c-88b1-fa796e10b255 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.864075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 354/703] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:24:18 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:18.880440 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd620245-39e1-4070-985f-581be288e1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.882823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd620245-39e1-4070-985f-581be288e1d6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:19.002172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:19.008766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 350/704] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:19.014646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e9506-26b4-4e1c-88b1-fa796e10b255 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:19.171220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:19.178845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e9506-26b4-4e1c-88b1-fa796e10b255 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:19.220936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:19.221612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.221894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.222175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.234927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:19.236469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:19.258208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:19.259136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:19.260077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:19.260077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:19.260077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:19.260077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:19.262515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 355/705] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:19.270100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620245-39e1-4070-985f-581be288e1d6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:19.470934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620245-39e1-4070-985f-581be288e1d6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:19.537112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fe9d9-419e-40e2-a563-071d922aadce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:19.538558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe9d9-419e-40e2-a563-071d922aadce None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.538996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe9d9-419e-40e2-a563-071d922aadce None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.539589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe9d9-419e-40e2-a563-071d922aadce None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.540842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fe9d9-419e-40e2-a563-071d922aadce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:19.541291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fe9d9-419e-40e2-a563-071d922aadce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:19.542890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fe9d9-419e-40e2-a563-071d922aadce None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:19.561577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 351/706] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:19.566931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:19.681661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8595-39a8-4b4e-b7dc-238bda04d750 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.682182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8595-39a8-4b4e-b7dc-238bda04d750 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.682596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8595-39a8-4b4e-b7dc-238bda04d750 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.684119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 352/707] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:19.689507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535a20-21a1-4ae4-a41b-c46baaef7fc2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.689926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535a20-21a1-4ae4-a41b-c46baaef7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.690342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535a20-21a1-4ae4-a41b-c46baaef7fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.697555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae21a-b603-4668-8894-e39758d92de5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:19.736560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-35535a20-21a1-4ae4-a41b-c46baaef7fc2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:19.737988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-35535a20-21a1-4ae4-a41b-c46baaef7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:19.739105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:19.740119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.741065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.741832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.752181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:19.754382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:19.768571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:19.769677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:19.770693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:19.770693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:19.770693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:19.770693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:19.770693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:19.770693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:19.770693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:19.770693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:19.773767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 356/708] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:19.780572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:19.795815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:19.886343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:19.909081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 353/709] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:19.910420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aa6b2-21d6-4879-b2e6-eef99a55650c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:19.935778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35535a20-21a1-4ae4-a41b-c46baaef7fc2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:19.956130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9150a-d040-4ec7-b043-fa80cdea0913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:19.956768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9150a-d040-4ec7-b043-fa80cdea0913 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.957052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9150a-d040-4ec7-b043-fa80cdea0913 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.957330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9150a-d040-4ec7-b043-fa80cdea0913 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.958094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9150a-d040-4ec7-b043-fa80cdea0913 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:19.958406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9150a-d040-4ec7-b043-fa80cdea0913 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:19.960422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9150a-d040-4ec7-b043-fa80cdea0913 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:19.981086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 357/710] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:19.982404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c58fe-4a64-41c2-a144-7bf0472b4542 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.982692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c58fe-4a64-41c2-a144-7bf0472b4542 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.982971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c58fe-4a64-41c2-a144-7bf0472b4542 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.984467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 358/711] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:19.986497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c58fe-4a64-41c2-a144-7bf0472b4542 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.066930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.077491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35535a20-21a1-4ae4-a41b-c46baaef7fc2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.105551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c58fe-4a64-41c2-a144-7bf0472b4542 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.117112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a24b8-0d44-424a-9f48-2bb967f4ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.118061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a24b8-0d44-424a-9f48-2bb967f4ad98 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.118536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a24b8-0d44-424a-9f48-2bb967f4ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.119005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a24b8-0d44-424a-9f48-2bb967f4ad98 None admin] PATH_INFO: `/v3/services/network` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.119908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a24b8-0d44-424a-9f48-2bb967f4ad98 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.121508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a24b8-0d44-424a-9f48-2bb967f4ad98 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-444a24b8-0d44-424a-9f48-2bb967f4ad98 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:20.133855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:20.134856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:20.136038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:20.138673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 354/712] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:19 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:20.140271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66e4f-4ba7-4ecb-9648-a3ccf98d351e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.140753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66e4f-4ba7-4ecb-9648-a3ccf98d351e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.140857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.141360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66e4f-4ba7-4ecb-9648-a3ccf98d351e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.141462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.141787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.142086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.142874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:20.143180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.144732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.155480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 359/713] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:19 2022] GET /identity/v3/role_assignments?user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=7a7079c0864e4bb7acaa71238097426e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:20.156431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.169474 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cfa66e4f-4ba7-4ecb-9648-a3ccf98d351e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:20.171250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cfa66e4f-4ba7-4ecb-9648-a3ccf98d351e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:20.275700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28555-7635-431c-9db9-f8d6326988a1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.280214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.317420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.319930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 355/714] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:20.329679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.330335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.330617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.330891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.331616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] RBAC: Adding query filter params (name=network) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:20.331921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.333381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.344780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 360/715] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:20.351120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa66e4f-4ba7-4ecb-9648-a3ccf98d351e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.359395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.529268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86048b96-db83-4746-a19d-c2f047985a34 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.586752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa66e4f-4ba7-4ecb-9648-a3ccf98d351e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.599801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.601025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.601305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.601630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.602266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.603688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:20.619414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:20.620515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:20.621362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 361/716] 10.222.0.71 () {56 vars in 1129 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:20.631286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.645925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.647232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.647534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.647807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.648487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] RBAC: Adding query filter params (type=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:20.648788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.650862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.657439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 356/717] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:20.759872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.792431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73585a86-7282-41f4-a7c9-58ae4de8ffb6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.838881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a953c2-fb99-43a6-86a9-152ff93a8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.839705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a953c2-fb99-43a6-86a9-152ff93a8508 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.839867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a953c2-fb99-43a6-86a9-152ff93a8508 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.840015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a953c2-fb99-43a6-86a9-152ff93a8508 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.840689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a953c2-fb99-43a6-86a9-152ff93a8508 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:20.840993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a953c2-fb99-43a6-86a9-152ff93a8508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.842418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a953c2-fb99-43a6-86a9-152ff93a8508 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.848141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 362/718] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:20.854844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.921726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.979870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666d74-0183-4732-a41f-869227d8c2eb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:21.029022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a6e9b-e63c-41aa-8896-de4e0ebbc01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:21.029661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6e9b-e63c-41aa-8896-de4e0ebbc01e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:21.029945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6e9b-e63c-41aa-8896-de4e0ebbc01e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:21.030225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6e9b-e63c-41aa-8896-de4e0ebbc01e None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:21.030913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a6e9b-e63c-41aa-8896-de4e0ebbc01e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:21.031222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a6e9b-e63c-41aa-8896-de4e0ebbc01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:21.032763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a6e9b-e63c-41aa-8896-de4e0ebbc01e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:21.044029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 357/719] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:21.439773 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967309-3a2c-47cb-a1a7-d33d9d5b86dd None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:21.440070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967309-3a2c-47cb-a1a7-d33d9d5b86dd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:21.440446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967309-3a2c-47cb-a1a7-d33d9d5b86dd None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:21.441992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 363/720] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:21.447856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb01a-ce79-437e-9299-8c491a496c63 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:21.448551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb01a-ce79-437e-9299-8c491a496c63 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:21.449070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb01a-ce79-437e-9299-8c491a496c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:21.480436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-97bcb01a-ce79-437e-9299-8c491a496c63 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:21.482015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-97bcb01a-ce79-437e-9299-8c491a496c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:21.581164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 358/721] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:21.617280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88967309-3a2c-47cb-a1a7-d33d9d5b86dd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:21.783586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5370-81bf-4955-960b-99bd9c8f3c9b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:21.784604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5370-81bf-4955-960b-99bd9c8f3c9b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:21.785096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5370-81bf-4955-960b-99bd9c8f3c9b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:21.786656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 359/722] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:21.793561 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0c1fc-88df-43a3-b673-c4d6e5828b13 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:21.793871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0c1fc-88df-43a3-b673-c4d6e5828b13 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:21.794105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0c1fc-88df-43a3-b673-c4d6e5828b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:21.803638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88967309-3a2c-47cb-a1a7-d33d9d5b86dd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:21.827743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-74e0c1fc-88df-43a3-b673-c4d6e5828b13 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:21.828965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-74e0c1fc-88df-43a3-b673-c4d6e5828b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:21.858148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:21.885271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d60ed-90b0-4f7a-961f-7fdc671f01e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:21.885935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d60ed-90b0-4f7a-961f-7fdc671f01e5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:21.886213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d60ed-90b0-4f7a-961f-7fdc671f01e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:21.886487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d60ed-90b0-4f7a-961f-7fdc671f01e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:21.913752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d60ed-90b0-4f7a-961f-7fdc671f01e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-745d60ed-90b0-4f7a-961f-7fdc671f01e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:21.919164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:21.920081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:21.920922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:21.923753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:21.929366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 364/723] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:21.931462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d60ed-90b0-4f7a-961f-7fdc671f01e5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:21.980337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 360/724] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:22.020680 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0c1fc-88df-43a3-b673-c4d6e5828b13 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:22.126255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d60ed-90b0-4f7a-961f-7fdc671f01e5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:22.176525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:22.177658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.178320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.178801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.179758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:22.180314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:22.182348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:22.200632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 365/725] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:22.208719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:22.228982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0c1fc-88df-43a3-b673-c4d6e5828b13 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:22.319920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a7bba-d695-469b-ae2f-7611256efe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:22.321824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a7bba-d695-469b-ae2f-7611256efe6f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.326587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a7bba-d695-469b-ae2f-7611256efe6f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.327141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a7bba-d695-469b-ae2f-7611256efe6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.342724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:22.348859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a7bba-d695-469b-ae2f-7611256efe6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b53a7bba-d695-469b-ae2f-7611256efe6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:22.356845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:22.357990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:22.358847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:22.365420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 361/726] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:22.371706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a7bba-d695-469b-ae2f-7611256efe6f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:22.440451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:22.468972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420267-cef2-47ae-b76c-4b3b19482426 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:22.510655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:22.512315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.513676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.514339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.530083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:22.532459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:22.550446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:22.551398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:22.552315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:22.552315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:22.552315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:22.552315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:22.552315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 366/727] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:22.558978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:22.602733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a7bba-d695-469b-ae2f-7611256efe6f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:22.684931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:22.685806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.686100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.686405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.687211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:22.687725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:22.689547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:22.715125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 362/728] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:22.721434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:22.735790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:22.741393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5708f-7d9f-4c13-a3c7-5f74bf91b6b3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:22.815772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5d80-7211-491b-96a0-f68444f5dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:22.816415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5d80-7211-491b-96a0-f68444f5dc0c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.816692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5d80-7211-491b-96a0-f68444f5dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.816963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5d80-7211-491b-96a0-f68444f5dc0c None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.818873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e5d80-7211-491b-96a0-f68444f5dc0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:22.819592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e5d80-7211-491b-96a0-f68444f5dc0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:22.822635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e5d80-7211-491b-96a0-f68444f5dc0c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:22.844668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 367/729] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:22.846438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728b69-70b7-4d86-8fe0-3f38cce7cdd4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.846731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728b69-70b7-4d86-8fe0-3f38cce7cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.847011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728b69-70b7-4d86-8fe0-3f38cce7cdd4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.854853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 368/730] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:22.855816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c728b69-70b7-4d86-8fe0-3f38cce7cdd4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:22.893235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:22.904984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1210f-5c61-4c22-b40b-8897ab68b71a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:22.953823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8641812-b707-4f91-b78d-c225410dd8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:22.954545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641812-b707-4f91-b78d-c225410dd8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.954826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641812-b707-4f91-b78d-c225410dd8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.955102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641812-b707-4f91-b78d-c225410dd8e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.966914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8641812-b707-4f91-b78d-c225410dd8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:22.968326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8641812-b707-4f91-b78d-c225410dd8e2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b8641812-b707-4f91-b78d-c225410dd8e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:22.984835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:22.985780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:22.987865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:22.987865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:22.987865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:22.987865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:22.987865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 363/731] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:22.987865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42159632-874f-4c6c-96ca-e2c32a1bbf33 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.988211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42159632-874f-4c6c-96ca-e2c32a1bbf33 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.988703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42159632-874f-4c6c-96ca-e2c32a1bbf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.007408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-42159632-874f-4c6c-96ca-e2c32a1bbf33 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:23.008721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c728b69-70b7-4d86-8fe0-3f38cce7cdd4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:23.009245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-42159632-874f-4c6c-96ca-e2c32a1bbf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:23.064292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.064953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.065266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.065979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.079237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:23.080979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:23.094222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:23.096844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:23.099194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:23.100598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 369/732] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:24:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:23.100965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 364/733] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:23.107429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.107655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42159632-874f-4c6c-96ca-e2c32a1bbf33 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.136066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.232754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964eba7b-31d0-4819-b621-3bb721b3336d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:23.275143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.275907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.276190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.276470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.277170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:23.277474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:23.279218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:23.297648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 370/734] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:23.297648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.358982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.383481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.386131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42159632-874f-4c6c-96ca-e2c32a1bbf33 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:23.410581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961300a-3e6a-44e0-9701-fb0707d33cbc None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:23.423755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdbd99-b355-4424-8131-cc969457a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.424689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdbd99-b355-4424-8131-cc969457a555 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.425121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdbd99-b355-4424-8131-cc969457a555 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.425544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdbd99-b355-4424-8131-cc969457a555 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.426484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdbd99-b355-4424-8131-cc969457a555 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:23.426937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdbd99-b355-4424-8131-cc969457a555 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:23.429130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdbd99-b355-4424-8131-cc969457a555 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:23.447871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff32d-7979-450b-8154-934cd02ce9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.448520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff32d-7979-450b-8154-934cd02ce9cd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.448803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff32d-7979-450b-8154-934cd02ce9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.449079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff32d-7979-450b-8154-934cd02ce9cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.449308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 365/735] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Aug 1 15:24:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:23.450944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf9192-a036-4b26-bbee-c5569c5b7c96 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.451227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf9192-a036-4b26-bbee-c5569c5b7c96 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.451526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf9192-a036-4b26-bbee-c5569c5b7c96 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.452903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 366/736] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:23.457629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf9192-a036-4b26-bbee-c5569c5b7c96 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.463907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ff32d-7979-450b-8154-934cd02ce9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4e0ff32d-7979-450b-8154-934cd02ce9cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:23.469496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:23.470566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:23.471360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:23.475451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 371/737] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:23.476279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff32d-7979-450b-8154-934cd02ce9cd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.570328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf9192-a036-4b26-bbee-c5569c5b7c96 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:23.583026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff32d-7979-450b-8154-934cd02ce9cd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:23.611317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3a612-efcb-4f32-af65-f2ed69d02f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.612000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3a612-efcb-4f32-af65-f2ed69d02f64 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.612446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3a612-efcb-4f32-af65-f2ed69d02f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.612724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3a612-efcb-4f32-af65-f2ed69d02f64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.615961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.618813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b169ae-0268-4e1e-a2e4-4332de8bc7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.619597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b169ae-0268-4e1e-a2e4-4332de8bc7bc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.619879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b169ae-0268-4e1e-a2e4-4332de8bc7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.620154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b169ae-0268-4e1e-a2e4-4332de8bc7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.627536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3a612-efcb-4f32-af65-f2ed69d02f64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:23.628996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3a612-efcb-4f32-af65-f2ed69d02f64 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:23.629951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-99d3a612-efcb-4f32-af65-f2ed69d02f64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:23.644014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:23.646542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 367/738] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5123b6-8390-42e0-921d-523710761c19 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.647888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5123b6-8390-42e0-921d-523710761c19 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.648740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5123b6-8390-42e0-921d-523710761c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.665184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ee5123b6-8390-42e0-921d-523710761c19 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:23.666378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ee5123b6-8390-42e0-921d-523710761c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:23.702208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b169ae-0268-4e1e-a2e4-4332de8bc7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:23.703751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b169ae-0268-4e1e-a2e4-4332de8bc7bc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:23.735448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 368/739] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:23.736310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5123b6-8390-42e0-921d-523710761c19 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.816552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 372/740] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:23.818060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c222-b3bc-436c-91dc-bbd6a351f331 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.818408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c222-b3bc-436c-91dc-bbd6a351f331 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.819304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c222-b3bc-436c-91dc-bbd6a351f331 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.820887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 373/741] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:23.821407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121c222-b3bc-436c-91dc-bbd6a351f331 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.842965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5123b6-8390-42e0-921d-523710761c19 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:23.863240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.868477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.879269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.879921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.880205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.880479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.881221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:23.881525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:23.882900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:23.891088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 369/742] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:23.891911 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.932241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121c222-b3bc-436c-91dc-bbd6a351f331 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:23.969573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.970250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.970543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.970819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.971642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:23.971948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:23.973399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:23.990475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 374/743] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Aug 1 15:24:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:23.991287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:23.997197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40996ea8-9ea4-4bce-a6ce-c7246c90f103 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.031057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba55bd-451a-4821-8a07-510adada23dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:24.031710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba55bd-451a-4821-8a07-510adada23dc None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.032001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba55bd-451a-4821-8a07-510adada23dc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.032294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba55bd-451a-4821-8a07-510adada23dc None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.032967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba55bd-451a-4821-8a07-510adada23dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:24.034331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba55bd-451a-4821-8a07-510adada23dc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:24.051438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 370/744] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:24:23 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:24.052794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c1da-90ab-4216-8281-813098fc5120 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.053086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c1da-90ab-4216-8281-813098fc5120 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.053364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c1da-90ab-4216-8281-813098fc5120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.083711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-73b2c1da-90ab-4216-8281-813098fc5120 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:24.085664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-73b2c1da-90ab-4216-8281-813098fc5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:24.094955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:24.105559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111197d-28ac-4721-b67b-6a7c5cdea5e7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.137337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:24.162047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:24.163326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.163667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.163944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.168742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 371/745] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:24 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:24.176788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:24.178823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:24.187418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2c1da-90ab-4216-8281-813098fc5120 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:24.204441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:24.205423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:24.206321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:24.206321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:24.206321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:24.206321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:24.207527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 375/746] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:24.208402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:24.302513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2c1da-90ab-4216-8281-813098fc5120 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.338067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed17be-9125-49ac-94ae-2d4533803551 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.339613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:24.340269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.340550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.340824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.352217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:24.353673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:24.368776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:24.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:24.370713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:24.370713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:24.370713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:24.370713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:24.374626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 372/747] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:24.375492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:24.378759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fcac3-0d80-40fd-875d-4c8da0bb3b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:24.379417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fcac3-0d80-40fd-875d-4c8da0bb3b78 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.379709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fcac3-0d80-40fd-875d-4c8da0bb3b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.379988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fcac3-0d80-40fd-875d-4c8da0bb3b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.396382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:24.408799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:24.467914 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fcac3-0d80-40fd-875d-4c8da0bb3b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:24.469503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fcac3-0d80-40fd-875d-4c8da0bb3b78 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:24.497298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b02ad-e8a8-4587-abc9-1addba4a00ad None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.536732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a44cc8-c4bf-449e-9a6e-6a4668462e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:24.537421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a44cc8-c4bf-449e-9a6e-6a4668462e7a None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.538213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a44cc8-c4bf-449e-9a6e-6a4668462e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.538587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a44cc8-c4bf-449e-9a6e-6a4668462e7a None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.539320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a44cc8-c4bf-449e-9a6e-6a4668462e7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:24.541913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a44cc8-c4bf-449e-9a6e-6a4668462e7a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:24.567490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 373/748] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:24:24 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:24.569048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a44cc8-c4bf-449e-9a6e-6a4668462e7a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:24.612845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 376/749] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:24 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:24.614130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fcac3-0d80-40fd-875d-4c8da0bb3b78 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:24.674905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:24.689521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:24.719737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a44cc8-c4bf-449e-9a6e-6a4668462e7a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.750409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fcac3-0d80-40fd-875d-4c8da0bb3b78 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.759755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:24.760391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.760674 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.760948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.761640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:24.761943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:24.763347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:24.782694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 374/750] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:24.782694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:24.803526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:24.804424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.804858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.805306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.806153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:24.806625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:24.808204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:24.824651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 377/751] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:24.825726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:24.923349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa197-9693-4e3d-ac76-75ac56870934 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.956031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f6e5-ad10-4838-a78f-cf4099466ed4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:24.959517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:24.965452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:24.966382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:24.966871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:24.967404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:24.978652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:24.980496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:24.983806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:24.999156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:25.000557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:25.001446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:25.001446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:25.001446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:25.001446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:25.002965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.007582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.007582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.007582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.008000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 375/752] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:25.009037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.012764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.015436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:25.028271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:25.029202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:25.030080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:25.030080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:25.030080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:25.030080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:25.030080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:25.030080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:25.030080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:25.030080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:25.032691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 378/753] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:25.033776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.148152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80981cd3-b7d8-4cb8-b126-056e2e82e3ad None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:25.154533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18dd8c-9b21-4f95-a301-bdc112ce5de3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:25.190245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.190772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.191061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.191334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:25.192358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.193784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:25.200110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.200770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.201053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.201326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.208610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 379/754] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:25.210257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.211829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.213636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:25.230994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:25.232040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:25.232986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 376/755] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:25.234053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.251782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:25.319759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:25.339506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a1d82-1294-4295-a9af-0c91ffb92ea9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:25.381440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.382426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.382928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.383258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e21ea-5774-4cff-a729-bf2c84294e05 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:25.385324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.388301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:25.388619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.391508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:25.410168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 380/756] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:25.411516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.427206 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.427997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.428767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.429062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.440767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.442505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:25.456067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:25.456974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:25.457840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:25.457840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:25.457840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:25.457840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:25.457840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:25.457840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:25.457840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:25.457840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:25.460356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 377/757] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:25.461490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.524701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:25.548513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e119-44ad-4c06-850e-ca6b4127068f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:25.579535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3464f8f-b0ae-4f8a-8bdd-05f01ed7cbef None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:25.585291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.585993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.586350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.586720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.587620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:25.588002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.589542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:25.602217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:25.613502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 381/758] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:25.614519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.625654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.627149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.627699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.628560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.629884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=c258d2b109444c4493bcddcfd6c0d47b) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:25.630425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.633539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:25.644835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 378/759] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/role_assignments?user.id=c258d2b109444c4493bcddcfd6c0d47b&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:25.646016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.802826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143ccab-9353-4ce3-8cd4-20255b58a54e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:25.855225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.856223 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.856688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.857109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.868005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1ce8f-c2c3-44c6-ae6b-4875634dbb28 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:25.872082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.873768 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:25.890529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:25.891573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:25.892458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:25.892458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:25.892458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:25.892458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:25.900088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 379/760] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:25.901651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:25.938898 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:25.976171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:25.976819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:25.977101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:25.977379 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:25.978132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:25.978450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:25.979932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.009954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 382/761] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:26.016433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.023438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955969a7-4159-4183-9f7f-6a6ec3fa57c9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.024270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.098110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.099117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.099715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.100229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.101229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:26.101796 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.112130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.138203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 380/762] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:26.144265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.162161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d68e9-4221-4a61-b97c-2512062af5cf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.220582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed35d1d-b5a7-4b47-a2d2-c378e6f28b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.221591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed35d1d-b5a7-4b47-a2d2-c378e6f28b4b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.222078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed35d1d-b5a7-4b47-a2d2-c378e6f28b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.222611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed35d1d-b5a7-4b47-a2d2-c378e6f28b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.223639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed35d1d-b5a7-4b47-a2d2-c378e6f28b4b None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=f2434616a540474f948c821e18e1a112) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:26.224157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed35d1d-b5a7-4b47-a2d2-c378e6f28b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.226409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed35d1d-b5a7-4b47-a2d2-c378e6f28b4b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.238845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 383/763] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/role_assignments?user.id=f2434616a540474f948c821e18e1a112&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=7a7079c0864e4bb7acaa71238097426e => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:26.241163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa85c46-2eff-4fb3-a265-2c23c68ccf22 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.241664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa85c46-2eff-4fb3-a265-2c23c68ccf22 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.248313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa85c46-2eff-4fb3-a265-2c23c68ccf22 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.250457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 384/764] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:26.265228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f70aa-5d78-4501-8a22-d6b674d06c8d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.265850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f70aa-5d78-4501-8a22-d6b674d06c8d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.266329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f70aa-5d78-4501-8a22-d6b674d06c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.296673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.304588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a41f70aa-5d78-4501-8a22-d6b674d06c8d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:26.305497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e55a10-75e9-45c0-93dc-a20b7cf3fbbe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.305793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a41f70aa-5d78-4501-8a22-d6b674d06c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:26.357558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.358145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.358426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.358701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.372847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.374346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:26.389661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:26.390604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:26.392051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 381/765] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:26.397277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.455771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.465453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 385/766] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:26.488311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f70aa-5d78-4501-8a22-d6b674d06c8d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.545977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb86ce-b865-46ee-8563-1e92d23d3a2c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.603403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.604444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.604991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.605473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.606418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:26.607025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.608764 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.622324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 382/767] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:26.637450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.648705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f70aa-5d78-4501-8a22-d6b674d06c8d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.664763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.699012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.702662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.703336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.703814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.711003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.712779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:26.725452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:26.726456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:26.727271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:26.730286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 386/768] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:26.736954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.827750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.847903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880fe97-2a65-4562-a1e7-db06e5f207d1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.865132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cce70-4b12-442d-a35c-45eed4fd7c0f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.889694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.890885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.891769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.892505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.893400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] RBAC: Adding query filter params (name=network) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:26.894035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.896264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.902964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd735b7-c6ae-4001-b49b-5f19289b3428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.903757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd735b7-c6ae-4001-b49b-5f19289b3428 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.903938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 387/769] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:26.908673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd735b7-c6ae-4001-b49b-5f19289b3428 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.908673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd735b7-c6ae-4001-b49b-5f19289b3428 None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/4aa7374d435f497d9e9bdd3c5d9d2c7c/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.910002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.910163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd735b7-c6ae-4001-b49b-5f19289b3428 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=4aa7374d435f497d9e9bdd3c5d9d2c7c, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.911747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd735b7-c6ae-4001-b49b-5f19289b3428 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.939803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 383/770] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:26 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/4aa7374d435f497d9e9bdd3c5d9d2c7c/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:24:26.960139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28570ac-6f1f-45c6-bf56-5f80ca15f8b5 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.960756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28570ac-6f1f-45c6-bf56-5f80ca15f8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.961227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28570ac-6f1f-45c6-bf56-5f80ca15f8b5 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.963822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 384/771] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:26.969003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af71c1a-4d7d-4377-b489-1059763c5b27 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.969559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af71c1a-4d7d-4377-b489-1059763c5b27 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.970271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af71c1a-4d7d-4377-b489-1059763c5b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.993802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5af71c1a-4d7d-4377-b489-1059763c5b27 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:26.995692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5af71c1a-4d7d-4377-b489-1059763c5b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:27.088824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 385/772] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:27.123472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af71c1a-4d7d-4377-b489-1059763c5b27 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.127724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.141587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31b164-41b6-465c-956c-1ed767378071 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.175789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.190643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.191286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.191613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.191890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.192576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] RBAC: Adding query filter params (type=network) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:27.192886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.194946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.204358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 388/773] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.210258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.247577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af71c1a-4d7d-4377-b489-1059763c5b27 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.291418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.291418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.291418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.291418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.291842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.291842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:27.299517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:27.300450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:27.301278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:27.312217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 386/774] 10.222.0.71 () {56 vars in 1129 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:27.312217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.338346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af540adb-6e3c-4e08-a566-18759eabcc54 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.425013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.427591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.428831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.431396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.431396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.431396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] RBAC: Adding query filter params (interface=public, service_id=4423061718c24f4aa89f6ded911036c9, region_id=RegionOne) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:27.431396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.431852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.459407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 389/775] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/endpoints?service_id=4423061718c24f4aa89f6ded911036c9&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:27.459407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.471404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aa32e-2df3-484c-8ed3-4e326ad1bb4f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.519400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.519400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.519400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.519400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.519824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:27.519824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.523399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.531402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 387/776] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.535399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.594568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.656127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461784a-3a9c-4a11-a68a-7b6a3345fb99 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.693651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.703229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77871e19-b4e9-453f-8c15-f4125c86ab84 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.714558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.716214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.716662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.717136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.717957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:27.718403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.724429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.739241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 388/777] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.748450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.753360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ec479-a136-463f-aff0-a734c478bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.754589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ec479-a136-463f-aff0-a734c478bd74 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.755044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ec479-a136-463f-aff0-a734c478bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.758505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ec479-a136-463f-aff0-a734c478bd74 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.759520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ec479-a136-463f-aff0-a734c478bd74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.763761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ec479-a136-463f-aff0-a734c478bd74 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.780212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 390/778] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/services => generated 772 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.977616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73170b5-323a-4eef-ab08-f361397f41a7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.022706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094899-4c51-4028-b449-30993b835993 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.023030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094899-4c51-4028-b449-30993b835993 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.023255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094899-4c51-4028-b449-30993b835993 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.024792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 391/779] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:28.030267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c85041-1810-4a51-9582-63ffaa2ad3ef None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.030532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c85041-1810-4a51-9582-63ffaa2ad3ef None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.030789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c85041-1810-4a51-9582-63ffaa2ad3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.045616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.046282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.046576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.046837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.047633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] RBAC: Adding query filter params (interface=public, service_id=660bb622888b412b8c87e9a52d17429b, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:28.047948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.049351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.066542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 389/780] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/endpoints?service_id=660bb622888b412b8c87e9a52d17429b&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:28.068143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.095400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c6c85041-1810-4a51-9582-63ffaa2ad3ef None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:28.095400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c6c85041-1810-4a51-9582-63ffaa2ad3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:28.158020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.203047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed06e6-cbe3-43e0-9c2b-165103c9fc0d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.250768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 392/781] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:28.255734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d26575-a0f2-4236-9d04-04feba33b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.256512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26575-a0f2-4236-9d04-04feba33b500 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.256896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26575-a0f2-4236-9d04-04feba33b500 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.257273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26575-a0f2-4236-9d04-04feba33b500 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.258040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d26575-a0f2-4236-9d04-04feba33b500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.259793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d26575-a0f2-4236-9d04-04feba33b500 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.265888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 390/782] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:28.278802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c85041-1810-4a51-9582-63ffaa2ad3ef None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.363804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.455006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c85041-1810-4a51-9582-63ffaa2ad3ef None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.494720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be346d7a-b4a8-4dc3-85cb-54cada35e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.495413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be346d7a-b4a8-4dc3-85cb-54cada35e938 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.495699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be346d7a-b4a8-4dc3-85cb-54cada35e938 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.495983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be346d7a-b4a8-4dc3-85cb-54cada35e938 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.509347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be346d7a-b4a8-4dc3-85cb-54cada35e938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-be346d7a-b4a8-4dc3-85cb-54cada35e938 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:28.514565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:28.515537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:28.516357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 393/783] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:28.522656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d26575-a0f2-4236-9d04-04feba33b500 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.635922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d26575-a0f2-4236-9d04-04feba33b500 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.659678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.675773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.676410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.676694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.676971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.677692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:28.678518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.679930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.689018 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 391/784] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:28.695068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be346d7a-b4a8-4dc3-85cb-54cada35e938 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.811298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be346d7a-b4a8-4dc3-85cb-54cada35e938 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.819961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.860312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeec75-ff1d-454f-ba03-2b704179ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.860965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeec75-ff1d-454f-ba03-2b704179ee20 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.861304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeec75-ff1d-454f-ba03-2b704179ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.861663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeec75-ff1d-454f-ba03-2b704179ee20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.875628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeec75-ff1d-454f-ba03-2b704179ee20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.877392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeec75-ff1d-454f-ba03-2b704179ee20 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-09aeec75-ff1d-454f-ba03-2b704179ee20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:28.898092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:28.899012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:28.899920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:28.899920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:28.899920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:28.899920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:28.899920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 394/785] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:28.905449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.959738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7b501-c241-4269-9fac-c7d411326191 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.960375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7b501-c241-4269-9fac-c7d411326191 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.960862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7b501-c241-4269-9fac-c7d411326191 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.962664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 395/786] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:28.967867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f3631-b501-45d6-882e-bbbc426e9037 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.968430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f3631-b501-45d6-882e-bbbc426e9037 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.968898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f3631-b501-45d6-882e-bbbc426e9037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.996726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-557f3631-b501-45d6-882e-bbbc426e9037 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:28.999014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-557f3631-b501-45d6-882e-bbbc426e9037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:29.069568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5333f-1c65-467f-9bf9-3fe165f532e7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.130858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 396/787] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:29.135765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.136629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.137190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.137671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.138631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:29.139158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.140798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.157523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 392/788] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:29.164474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f3631-b501-45d6-882e-bbbc426e9037 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.171333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.259764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.272595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f3631-b501-45d6-882e-bbbc426e9037 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.287575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.309962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.310609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.310893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.311169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.319914 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.321761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:29.336242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:29.337159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:29.338287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 397/789] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:29.343681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.426029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a607-6ee0-4e11-965e-626ba38eec26 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.468462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63fb0-0e77-4c96-bb31-19e1ac9a8e19 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.502651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18e37f-344a-4142-948d-4a1372a7c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.503829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18e37f-344a-4142-948d-4a1372a7c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.504095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18e37f-344a-4142-948d-4a1372a7c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.504358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18e37f-344a-4142-948d-4a1372a7c4d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.517810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18e37f-344a-4142-948d-4a1372a7c4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2f18e37f-344a-4142-948d-4a1372a7c4d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:29.523982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:29.526252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:29.528229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 393/790] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:29.535397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18e37f-344a-4142-948d-4a1372a7c4d7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.535653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.535653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.535653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.535653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.536249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:29.536249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.541813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.581869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 398/791] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:29.587118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.600680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.651264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18e37f-344a-4142-948d-4a1372a7c4d7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.654231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.696011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5571-3203-43f6-a60f-18036fa1e05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.696884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5571-3203-43f6-a60f-18036fa1e05e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.697354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5571-3203-43f6-a60f-18036fa1e05e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.697867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5571-3203-43f6-a60f-18036fa1e05e None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.698866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b5571-3203-43f6-a60f-18036fa1e05e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:29.699399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b5571-3203-43f6-a60f-18036fa1e05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.701750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b5571-3203-43f6-a60f-18036fa1e05e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.714691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 394/792] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:29.716790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af6f7-7b28-401c-bfa4-14a9d51e479b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.717509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af6f7-7b28-401c-bfa4-14a9d51e479b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.717935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af6f7-7b28-401c-bfa4-14a9d51e479b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.720145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 395/793] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:29.721578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83af6f7-7b28-401c-bfa4-14a9d51e479b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.766114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211f1b2-30b4-4bd2-9545-39841dc84a22 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.812534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d51b-e0e2-4175-b871-fa11d0644b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.813755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d51b-e0e2-4175-b871-fa11d0644b3c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.814213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d51b-e0e2-4175-b871-fa11d0644b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.815434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d51b-e0e2-4175-b871-fa11d0644b3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.829682 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d51b-e0e2-4175-b871-fa11d0644b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.831864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d51b-e0e2-4175-b871-fa11d0644b3c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6826d51b-e0e2-4175-b871-fa11d0644b3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:29.851776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:29.852866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:29.854116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:29.854116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:29.854116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:29.854116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:29.854377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83af6f7-7b28-401c-bfa4-14a9d51e479b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.857318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 399/794] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:29.858824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42da2d-dc59-430f-b3ce-f5c2fefc6d2c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.859241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42da2d-dc59-430f-b3ce-f5c2fefc6d2c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.859667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42da2d-dc59-430f-b3ce-f5c2fefc6d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.883519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5e42da2d-dc59-430f-b3ce-f5c2fefc6d2c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:29.885605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5e42da2d-dc59-430f-b3ce-f5c2fefc6d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:29.899131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.899131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.899131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.899131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.910993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.912835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:29.930029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:29.931156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:29.932273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:29.932273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:29.932273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:29.932273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:29.934213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 396/795] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:29.935459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.963079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.968189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.986912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 400/796] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:29.986912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42da2d-dc59-430f-b3ce-f5c2fefc6d2c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.078906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688881f-17b8-4f0a-88d7-ed0494476b5b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.093596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42da2d-dc59-430f-b3ce-f5c2fefc6d2c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.119910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.120982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.121481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.121969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.122947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:30.123478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.125104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:30.131628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.132249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.132531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.132808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.133490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:30.133796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.135205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:30.146749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 397/797] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:30.147542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 401/798] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:30.149078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.151713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.204847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.239626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.265734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc386-16e1-4440-ab15-f03b1f2fa231 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.276699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d95e3-9af6-4ddf-b829-edc9c1c310b2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.304825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6d0a5-99ac-4c27-a808-5b29ce9fc49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.305752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d0a5-99ac-4c27-a808-5b29ce9fc49c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.306027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d0a5-99ac-4c27-a808-5b29ce9fc49c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.306375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d0a5-99ac-4c27-a808-5b29ce9fc49c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.313953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.314870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.315352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.315847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.318044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6d0a5-99ac-4c27-a808-5b29ce9fc49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d2b6d0a5-99ac-4c27-a808-5b29ce9fc49c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:30.323192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:30.324274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:30.325100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 398/799] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:30.325776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6d0a5-99ac-4c27-a808-5b29ce9fc49c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.326827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.328648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:30.342086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:30.343094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:30.344009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:30.344009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:30.344009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:30.344009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:30.344009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:30.344009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:30.344009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:30.344009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:30.346581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 402/800] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:30.347755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.448876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6d0a5-99ac-4c27-a808-5b29ce9fc49c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.459694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139f84a-0264-4fef-8a13-1e0551eeb20e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.469439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.487610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb25ea-2b00-42f4-9533-828f26542e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.488415 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb25ea-2b00-42f4-9533-828f26542e01 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.489002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb25ea-2b00-42f4-9533-828f26542e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.489297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb25ea-2b00-42f4-9533-828f26542e01 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.496642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb25ea-2b00-42f4-9533-828f26542e01 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.496863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.497485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.497768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.498045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.498144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb25ea-2b00-42f4-9533-828f26542e01 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:30.498757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:30.499062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.500007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.500458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:30.510026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 403/801] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:30.510674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-21cb25ea-2b00-42f4-9533-828f26542e01 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:30.516725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:30.517683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:30.518592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 399/802] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:30.519676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616defeb-bfc0-4956-bc49-97685cbc25f8 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.519775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616defeb-bfc0-4956-bc49-97685cbc25f8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.520018 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616defeb-bfc0-4956-bc49-97685cbc25f8 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.521371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 400/803] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:30.522577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616defeb-bfc0-4956-bc49-97685cbc25f8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.622748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ea9fd-1853-44a5-9032-1281ad575b27 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.640346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616defeb-bfc0-4956-bc49-97685cbc25f8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.659489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.660112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.660396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.660669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.661412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:30.661717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.663728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:30.675587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584015a2-6130-4ac3-91ba-9df14b006229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.676239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584015a2-6130-4ac3-91ba-9df14b006229 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.676523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584015a2-6130-4ac3-91ba-9df14b006229 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.677011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 404/804] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:30.677964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.682188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584015a2-6130-4ac3-91ba-9df14b006229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.693250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584015a2-6130-4ac3-91ba-9df14b006229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.694733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584015a2-6130-4ac3-91ba-9df14b006229 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-584015a2-6130-4ac3-91ba-9df14b006229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:30.710058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:30.710971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:30.711870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:30.711870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:30.711870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:30.711870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:30.711870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 401/805] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:30.712491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167bd50-2e41-4323-b89e-465453712915 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.712642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167bd50-2e41-4323-b89e-465453712915 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.712921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167bd50-2e41-4323-b89e-465453712915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.716139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.733870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7167bd50-2e41-4323-b89e-465453712915 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:30.735068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7167bd50-2e41-4323-b89e-465453712915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:30.783193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.796046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56658b17-8000-4361-b4be-bbe689da8267 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.819413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 402/806] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:30.819413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167bd50-2e41-4323-b89e-465453712915 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.851611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.852242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.852523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.852823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.853589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:30.853892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.855351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:30.875194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 405/807] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Aug 1 15:24:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:30.876154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:30.935489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167bd50-2e41-4323-b89e-465453712915 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.966094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.970158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642e0c6-48ae-4816-8f81-01f1a88a87cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:30.970813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e0c6-48ae-4816-8f81-01f1a88a87cc None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.971100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e0c6-48ae-4816-8f81-01f1a88a87cc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.971390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e0c6-48ae-4816-8f81-01f1a88a87cc None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/c258d2b109444c4493bcddcfd6c0d47b/roles/b0731d356a6144c3a373a2085c88f855` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.979280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bb858-2eaa-48dd-b1f5-478d5bf77021 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:30.986429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642e0c6-48ae-4816-8f81-01f1a88a87cc None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=c258d2b109444c4493bcddcfd6c0d47b, role_id=b0731d356a6144c3a373a2085c88f855)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:30.987920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642e0c6-48ae-4816-8f81-01f1a88a87cc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.001187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 403/808] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:30 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/c258d2b109444c4493bcddcfd6c0d47b/roles/b0731d356a6144c3a373a2085c88f855 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:31.002072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642e0c6-48ae-4816-8f81-01f1a88a87cc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.019493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d7e36-31d8-469a-ba3d-6f73eb18ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.020469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7e36-31d8-469a-ba3d-6f73eb18ca37 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.020931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7e36-31d8-469a-ba3d-6f73eb18ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.021229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7e36-31d8-469a-ba3d-6f73eb18ca37 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.022847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7e36-31d8-469a-ba3d-6f73eb18ca37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:31.023161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7e36-31d8-469a-ba3d-6f73eb18ca37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.024612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7e36-31d8-469a-ba3d-6f73eb18ca37 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.034553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.043008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 406/809] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:31.044679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda21d9-46e5-4534-b8a5-1ab4606514e1 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.045112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda21d9-46e5-4534-b8a5-1ab4606514e1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.045529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda21d9-46e5-4534-b8a5-1ab4606514e1 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.047469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 407/810] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:31.049107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda21d9-46e5-4534-b8a5-1ab4606514e1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.126405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642e0c6-48ae-4816-8f81-01f1a88a87cc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.172585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.173238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.173517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.173784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.175087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.175203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda21d9-46e5-4534-b8a5-1ab4606514e1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.175817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:31.188210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:31.189304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:31.190156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 404/811] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:31.190916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.219981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fb5c3-e201-45ed-a226-2241db517b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.220562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fb5c3-e201-45ed-a226-2241db517b77 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.220850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fb5c3-e201-45ed-a226-2241db517b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.221134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fb5c3-e201-45ed-a226-2241db517b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.231779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fb5c3-e201-45ed-a226-2241db517b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.233263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fb5c3-e201-45ed-a226-2241db517b77 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.248318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-070fb5c3-e201-45ed-a226-2241db517b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:31.257986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:31.258953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:31.259895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:31.259895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:31.259895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:31.259895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:31.267455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 408/812] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:31.269385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eaac3-be2a-4777-b641-43e18dd4e9ae None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.269669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eaac3-be2a-4777-b641-43e18dd4e9ae None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.270225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eaac3-be2a-4777-b641-43e18dd4e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.289640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-434eaac3-be2a-4777-b641-43e18dd4e9ae None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:31.291091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-434eaac3-be2a-4777-b641-43e18dd4e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:31.299547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.308664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa85c43-83d0-4975-87ab-925b605301e3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.346404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.347146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.347532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.347872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.357692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.359359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.371406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 409/813] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:31.371406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434eaac3-be2a-4777-b641-43e18dd4e9ae None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:31.379550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:31.380600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:24:31.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:31.383333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 405/814] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:31.384190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.481444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434eaac3-be2a-4777-b641-43e18dd4e9ae None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.499687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449332b-c810-4b11-9556-e5c8a8dd5ee5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.513995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.521712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.522427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.522821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.523186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.524029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] RBAC: Adding query filter params (name=network) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:31.524418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.525894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.537843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 410/815] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:31.537843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.552189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.553469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.553762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.554039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.554765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:31.555046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.556542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.569973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 406/816] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:31.571138 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.588635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.657716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18a17-ba7b-4835-9f67-e2c0eabb6b42 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.692368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558570-b348-4930-bc8a-f656e68b0b61 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.697751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.698500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.698891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.699272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.700240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:31.700555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.702286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.727426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 411/817] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:31.727804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.737585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.738172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.738457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.738732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.739349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.741230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:31.751688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:31.752634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:31.753638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 407/818] 10.222.0.71 () {56 vars in 1129 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:31.754481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.794198 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.844413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.850684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e730147-aa29-46f1-b3e1-6e9ecdfd0916 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.872321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30887cc-be0b-4f26-9376-5e33f4558aac None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.893072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.894451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.895177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.895698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.897048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] RBAC: Adding query filter params (type=network) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:31.897686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.899531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.909894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 412/819] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:31.909894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.912556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.913221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.913511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.913794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.921328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.922809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:31.936279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:31.937471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:31.938668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:31.938668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:31.938668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:31.938668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:31.938668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:31.938668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:31.938668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:31.938668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:31.942353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 408/820] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:31.943196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.027922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca654d6-a46e-4380-b5b7-584fa8ea77da None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.046307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.051455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e009e4-b199-48dd-9377-2339794ae750 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.068981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a996a9b-215c-454b-bfe0-7b2b83ebc56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.069611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996a9b-215c-454b-bfe0-7b2b83ebc56d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.069893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996a9b-215c-454b-bfe0-7b2b83ebc56d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.070173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996a9b-215c-454b-bfe0-7b2b83ebc56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.092553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.093185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.093471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.093749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.094464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:32.094845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.096317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.102011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 409/821] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:32.102790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.105318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.155575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a996a9b-215c-454b-bfe0-7b2b83ebc56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.157094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a996a9b-215c-454b-bfe0-7b2b83ebc56d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.221710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3e2d7-4873-493d-aa89-427bab3e20a2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.269908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b48e01-8ca6-4013-89f3-68991d235db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.270540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48e01-8ca6-4013-89f3-68991d235db6 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.270828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48e01-8ca6-4013-89f3-68991d235db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.271107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48e01-8ca6-4013-89f3-68991d235db6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.272449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b48e01-8ca6-4013-89f3-68991d235db6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.273824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b48e01-8ca6-4013-89f3-68991d235db6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.282463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 413/822] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:24:32.283807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a996a9b-215c-454b-bfe0-7b2b83ebc56d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.297006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 410/823] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:24:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:32.297840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b48e01-8ca6-4013-89f3-68991d235db6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.317811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.399233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.440399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a996a9b-215c-454b-bfe0-7b2b83ebc56d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.472225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b48e01-8ca6-4013-89f3-68991d235db6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.488716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.489810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.490208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.491090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.491766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:32.492076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.493555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.510037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 414/824] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:32.511218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.523724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.524361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.524649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.524929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.525968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:32.526311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.528073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.547556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 411/825] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:32.548433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.628740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.658766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee43d-314a-4c22-99b8-0f96e5d5d891 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.691530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51092d77-0a36-42f2-843d-f5dd305da54c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.704087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.704856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.705136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.705419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.719643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.719835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.721216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.739871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9713136-2cce-4d62-bc0f-c0f6be9d71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.741094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713136-2cce-4d62-bc0f-c0f6be9d71c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:32.741204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:32.742008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:32.752832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:32.752832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:32.752832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:32.752832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:32.753120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713136-2cce-4d62-bc0f-c0f6be9d71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.753120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713136-2cce-4d62-bc0f-c0f6be9d71c6 None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/f2434616a540474f948c821e18e1a112/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.753120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9713136-2cce-4d62-bc0f-c0f6be9d71c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=f2434616a540474f948c821e18e1a112, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.753497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 415/826] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:32.753497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.753688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9713136-2cce-4d62-bc0f-c0f6be9d71c6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.776413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 412/827] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:32 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/f2434616a540474f948c821e18e1a112/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:32.776413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9713136-2cce-4d62-bc0f-c0f6be9d71c6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.884424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b75b2-6404-4285-be77-1cf757ad26a3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.918883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.930284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f3a0-7aee-4add-a398-3e55a2c8aae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.931212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f3a0-7aee-4add-a398-3e55a2c8aae1 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.931696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f3a0-7aee-4add-a398-3e55a2c8aae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.932114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f3a0-7aee-4add-a398-3e55a2c8aae1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.933151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266f3a0-7aee-4add-a398-3e55a2c8aae1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.935718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266f3a0-7aee-4add-a398-3e55a2c8aae1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.937704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9713136-2cce-4d62-bc0f-c0f6be9d71c6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.970323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 416/828] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:24:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:32.988736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee836eb-e4da-4036-a51d-1a62c2a9262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.989377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee836eb-e4da-4036-a51d-1a62c2a9262e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.990986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee836eb-e4da-4036-a51d-1a62c2a9262e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.990986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee836eb-e4da-4036-a51d-1a62c2a9262e None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.992180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee836eb-e4da-4036-a51d-1a62c2a9262e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:32.992180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee836eb-e4da-4036-a51d-1a62c2a9262e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.993204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee836eb-e4da-4036-a51d-1a62c2a9262e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.007955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 413/829] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.014800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f3a0-7aee-4add-a398-3e55a2c8aae1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.077904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372cda-e7b6-47fd-bb30-33dd42900b20 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.077904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372cda-e7b6-47fd-bb30-33dd42900b20 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.077904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372cda-e7b6-47fd-bb30-33dd42900b20 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.079289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 414/830] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:33.086552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bac2e-99bc-4596-973e-141fde916ffa None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.087467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bac2e-99bc-4596-973e-141fde916ffa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.087994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bac2e-99bc-4596-973e-141fde916ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.110811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9f3bac2e-99bc-4596-973e-141fde916ffa None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:33.113011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9f3bac2e-99bc-4596-973e-141fde916ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:33.146679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.158092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f3a0-7aee-4add-a398-3e55a2c8aae1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.199202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.203427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.203427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.203427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.203713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 415/831] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:33.211993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.213580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.226643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bac2e-99bc-4596-973e-141fde916ffa None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:33.226856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:33.227747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:33.228657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 417/832] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:33.234946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.290614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.357582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203671f8-58a5-41c9-9813-eb1d31c04fc6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.364427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bac2e-99bc-4596-973e-141fde916ffa None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.396916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.397559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.397845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.398127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.398883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:33.399195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.400882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.406245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8262a3-651a-43dd-8b0e-94315a84df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.407422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8262a3-651a-43dd-8b0e-94315a84df96 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.407780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8262a3-651a-43dd-8b0e-94315a84df96 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.408124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8262a3-651a-43dd-8b0e-94315a84df96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.414860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 418/833] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.420750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.421534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8262a3-651a-43dd-8b0e-94315a84df96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2c8262a3-651a-43dd-8b0e-94315a84df96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:33.428979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:33.430132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:24:33.431169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:33.435465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 416/834] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:33.439298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8262a3-651a-43dd-8b0e-94315a84df96 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.469435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.543606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5529cf-ccbd-482c-8222-391245c4f58f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.546629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.569595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8262a3-651a-43dd-8b0e-94315a84df96 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.583788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.584459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.584744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.585021 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.586031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:33.586343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.588879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.603825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 419/835] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/role_assignments?user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=7a7079c0864e4bb7acaa71238097426e => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.611034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.611965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.612393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.612810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.613695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:33.614181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.616452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.627836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 417/836] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.634614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.763911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92226ff-f6b4-42a3-aeb0-c1cd60715b98 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.806204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.807002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.807400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.807769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.820564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.822389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:33.839130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:33.840290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:33.841398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:33.841398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:33.841398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:33.841398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:33.842668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 420/837] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:33.847520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.948075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.963851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fbd6e-2b69-4df8-b598-1e71272c9238 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.999204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.999865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.000147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.000420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.001276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:34.001579 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.002943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.016865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 418/838] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:34.022429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.048582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.137214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ebe0-7e50-4e81-9fb3-74abaaac99b3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.176211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.176868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.177146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.177424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.186117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.187606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:34.200126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:34.202175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:34.203881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 421/839] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:24:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:34.207637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.334998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b886d-33a0-4652-8e94-4363bccffa53 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.372462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.373084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.373365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.373638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.374430 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:34.374736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.376203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.394712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 419/840] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Aug 1 15:24:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:34.401520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.513486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.522940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d1ad4-4e3d-4166-99b4-bccc39285616 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.559275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238169e-8aa4-4fac-b4d9-c25d6bc479be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.559934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238169e-8aa4-4fac-b4d9-c25d6bc479be None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.560213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238169e-8aa4-4fac-b4d9-c25d6bc479be None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.560484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238169e-8aa4-4fac-b4d9-c25d6bc479be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.632982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238169e-8aa4-4fac-b4d9-c25d6bc479be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.634915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238169e-8aa4-4fac-b4d9-c25d6bc479be None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.721579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.743449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 422/841] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:24:34.752541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.757535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.867603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052145b-a8a8-433c-a86e-d5ac02ecd707 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.907352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7feb3a-9dfb-4be8-8674-6f7726ee7f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.907961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feb3a-9dfb-4be8-8674-6f7726ee7f0c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.908385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feb3a-9dfb-4be8-8674-6f7726ee7f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.908786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feb3a-9dfb-4be8-8674-6f7726ee7f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.921713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7feb3a-9dfb-4be8-8674-6f7726ee7f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.923172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7feb3a-9dfb-4be8-8674-6f7726ee7f0c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6b7feb3a-9dfb-4be8-8674-6f7726ee7f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:34.940372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:34.942178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:34.944526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:34.944526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:34.944526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:34.944526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:34.944526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 420/842] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:34.952672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238169e-8aa4-4fac-b4d9-c25d6bc479be None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.976702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf7d5-f667-4e75-b4b8-f8849982d705 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.977365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf7d5-f667-4e75-b4b8-f8849982d705 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.977864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf7d5-f667-4e75-b4b8-f8849982d705 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.979804 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 421/843] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:34.985099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcf197-24fa-47a9-9d72-d0bb4050eac6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.985387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcf197-24fa-47a9-9d72-d0bb4050eac6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.985664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcf197-24fa-47a9-9d72-d0bb4050eac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.013584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ebbcf197-24fa-47a9-9d72-d0bb4050eac6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:35.014833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ebbcf197-24fa-47a9-9d72-d0bb4050eac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:35.072852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.077763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238169e-8aa4-4fac-b4d9-c25d6bc479be None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.095034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 422/844] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:35.120622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.121611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.122136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.122691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.123192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcf197-24fa-47a9-9d72-d0bb4050eac6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.123417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:35.123775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.125171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.140061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 423/845] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:35.144785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.216660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.264231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcf197-24fa-47a9-9d72-d0bb4050eac6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.301611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ce74-8082-44d2-a5a9-0c0da9b20cd5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.324077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e76ff-347c-49ac-a6c5-5d5c1a5df021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.324465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e76ff-347c-49ac-a6c5-5d5c1a5df021 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.324743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e76ff-347c-49ac-a6c5-5d5c1a5df021 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.325086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e76ff-347c-49ac-a6c5-5d5c1a5df021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.338836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e76ff-347c-49ac-a6c5-5d5c1a5df021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:35.346006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a1f09-2a28-4b82-909a-f97b7dc193ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.346784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1f09-2a28-4b82-909a-f97b7dc193ea None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.347067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1f09-2a28-4b82-909a-f97b7dc193ea None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.347340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1f09-2a28-4b82-909a-f97b7dc193ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8c9e76ff-347c-49ac-a6c5-5d5c1a5df021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:35.348821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:35.350236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:35.351060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:35.352318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 423/846] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:35.354030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635efe-018b-4fce-9752-a024b0804b21 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.354536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635efe-018b-4fce-9752-a024b0804b21 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.355030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635efe-018b-4fce-9752-a024b0804b21 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.361904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 424/847] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:35.361904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f635efe-018b-4fce-9752-a024b0804b21 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.363340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a1f09-2a28-4b82-909a-f97b7dc193ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.364703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a1f09-2a28-4b82-909a-f97b7dc193ea None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-279a1f09-2a28-4b82-909a-f97b7dc193ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:35.385858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:35.386815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:35.387717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 424/848] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:35.392318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01575ead-9c3e-4fb0-bd51-693b88b60c0b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.392868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01575ead-9c3e-4fb0-bd51-693b88b60c0b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.393254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01575ead-9c3e-4fb0-bd51-693b88b60c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.413201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-01575ead-9c3e-4fb0-bd51-693b88b60c0b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:35.415562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-01575ead-9c3e-4fb0-bd51-693b88b60c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:35.433433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.492229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f635efe-018b-4fce-9752-a024b0804b21 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.493665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 425/849] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:35.494831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01575ead-9c3e-4fb0-bd51-693b88b60c0b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.545129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.548017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.549367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.549706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.550142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.551153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:35.551563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.552977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.567811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 425/850] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:35.567811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.637852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01575ead-9c3e-4fb0-bd51-693b88b60c0b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.680415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.681285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.681710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.682125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.683015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:35.683528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.685112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.699341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 426/851] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:35.700209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.715931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbfac-c65e-4c99-a0dc-d0221b8cde05 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.725782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.753754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.754401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.754597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.754881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.755547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.757505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:35.766644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:35.768481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:35.769903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:35.773291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 426/852] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:35.774286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.827392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.839413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90263-05f8-47ee-95ab-6d83916596fa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.886436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.887131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.887358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.887660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.894899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06838d7-9be7-476c-a57b-17aa3d780d39 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.899670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.901122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:35.917147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:35.918083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:35.919001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:35.919001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:35.919001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:35.919001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:35.919001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 427/853] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:35.919754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.941861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.942750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.943031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.943858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.944707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=c258d2b109444c4493bcddcfd6c0d47b) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:35.945018 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.946455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.952831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 427/854] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/role_assignments?user.id=c258d2b109444c4493bcddcfd6c0d47b&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:35.953661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.005564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.056761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1837f-1347-4e44-8fed-9484ac42f5fb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.100785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e0e1b-bbbc-4b62-aae5-33bf422bb76f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.103388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1bf65-9ad0-4f3a-84eb-d84b0affd38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.105256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1bf65-9ad0-4f3a-84eb-d84b0affd38c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.106035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1bf65-9ad0-4f3a-84eb-d84b0affd38c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.106702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1bf65-9ad0-4f3a-84eb-d84b0affd38c None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.108355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1bf65-9ad0-4f3a-84eb-d84b0affd38c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:36.109583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1bf65-9ad0-4f3a-84eb-d84b0affd38c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.112649 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1bf65-9ad0-4f3a-84eb-d84b0affd38c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.117859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 428/855] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:36.119077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce60db-9f4e-416c-94c6-ac7a53e37876 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.119390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce60db-9f4e-416c-94c6-ac7a53e37876 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.119681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce60db-9f4e-416c-94c6-ac7a53e37876 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.120904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 429/856] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:36.124606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce60db-9f4e-416c-94c6-ac7a53e37876 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.135644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.148904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a63e5-8941-4a45-8696-44e628cef34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.149540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a63e5-8941-4a45-8696-44e628cef34b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.149824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a63e5-8941-4a45-8696-44e628cef34b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.150101 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a63e5-8941-4a45-8696-44e628cef34b None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.151232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a63e5-8941-4a45-8696-44e628cef34b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:36.151232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a63e5-8941-4a45-8696-44e628cef34b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.152586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a63e5-8941-4a45-8696-44e628cef34b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.165510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 428/857] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:36.166859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eccfe-6d06-4429-8099-a5c6e5bfb6ed None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.167153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eccfe-6d06-4429-8099-a5c6e5bfb6ed None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.167674 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eccfe-6d06-4429-8099-a5c6e5bfb6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.191181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-671eccfe-6d06-4429-8099-a5c6e5bfb6ed None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:36.192416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-671eccfe-6d06-4429-8099-a5c6e5bfb6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:36.270613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce60db-9f4e-416c-94c6-ac7a53e37876 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.294122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 429/858] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:36.294999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eccfe-6d06-4429-8099-a5c6e5bfb6ed None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.313146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.314375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.314764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.315142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.315970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:36.316455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.318499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.323412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.324172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 430/859] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:36.324894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.413127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.427415 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eccfe-6d06-4429-8099-a5c6e5bfb6ed None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.452862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde8bde-cdce-4482-a4b9-4693ed5ee892 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.470065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.471323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.471782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.472211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.481073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.482985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.491872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.492566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.492850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.493126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.493759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.495300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:36.496918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:36.497817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:36.498757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 430/860] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:24:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:36.505569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:36.505996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:36.507406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:36.508242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 431/861] 10.222.0.71 () {56 vars in 1132 bytes} [Mon Aug 1 15:24:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:36.514038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.620203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.640819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2056d-aa1a-4070-89ac-5e01f9a59cd8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.674093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c6f3f-1eeb-4064-a39d-f9b5979be4f2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.689538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.690969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.691715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.692141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.693428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:36.694293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.696000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.713498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.714236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.714589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.714934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.715720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:36.716097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.717574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.719139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.722473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 431/862] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Aug 1 15:24:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:36.728407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.730000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 432/863] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:36.737057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.852936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96cda6-fbcf-42fe-b4bb-050ac8c9b3b0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.861552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2d19f-9340-4dda-9f89-7cae146afdad None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.893283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63071-7e7b-4781-a89d-b0994d51456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.894262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63071-7e7b-4781-a89d-b0994d51456b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.894744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63071-7e7b-4781-a89d-b0994d51456b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.895215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63071-7e7b-4781-a89d-b0994d51456b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.910851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.913774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.914337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.914447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.915608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.916038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:36.916346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.918851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.927405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 433/864] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:36.997126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c63071-7e7b-4781-a89d-b0994d51456b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.998749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c63071-7e7b-4781-a89d-b0994d51456b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:37.129278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 432/865] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:24:37.135115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.203293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.252394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62741a49-6404-4438-a365-d425733c27c2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:37.289204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:37.289860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.290396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.290678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.301861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:37.303988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:37.320039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:37.320979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:37.322436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:37.322436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:37.322436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:37.322436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:37.322436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 434/866] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:37.327292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63071-7e7b-4781-a89d-b0994d51456b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.407745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.442099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63071-7e7b-4781-a89d-b0994d51456b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:37.482810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:37.483356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.483663 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.483940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.484628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:37.484935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:37.486305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:37.499124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 433/867] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:37.504522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.618652 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec469af-ff69-42d7-8d35-8324c5d220cc None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:37.634900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.656883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:37.657551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.657827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.658100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.666455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:37.668027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:37.680265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:37.681197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:37.682444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 435/868] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:37.687254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.825816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6258c3-6422-4a5b-a596-9ec222de2a92 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:37.828261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.865016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4dc58-ab1b-485d-8c04-e2a8981f878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:37.866333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dc58-ab1b-485d-8c04-e2a8981f878a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.866494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dc58-ab1b-485d-8c04-e2a8981f878a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.866702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dc58-ab1b-485d-8c04-e2a8981f878a None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.867484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4dc58-ab1b-485d-8c04-e2a8981f878a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:37.867791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4dc58-ab1b-485d-8c04-e2a8981f878a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:37.869222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4dc58-ab1b-485d-8c04-e2a8981f878a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:37.882203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 434/869] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:37.888215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.999858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad977a6f-80b5-4ca1-b8eb-c2fa5e32040f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.036007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd87ed-2412-453d-a4bb-96f4d323ab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.036638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd87ed-2412-453d-a4bb-96f4d323ab38 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.036922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd87ed-2412-453d-a4bb-96f4d323ab38 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.037240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd87ed-2412-453d-a4bb-96f4d323ab38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.038040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd87ed-2412-453d-a4bb-96f4d323ab38 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=f2434616a540474f948c821e18e1a112) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:38.038357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd87ed-2412-453d-a4bb-96f4d323ab38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:38.039894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd87ed-2412-453d-a4bb-96f4d323ab38 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:38.047010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 436/870] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/role_assignments?user.id=f2434616a540474f948c821e18e1a112&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=7a7079c0864e4bb7acaa71238097426e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:38.221718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece572-6b03-4674-94b7-e33d1ff1519a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.221915 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece572-6b03-4674-94b7-e33d1ff1519a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.222302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece572-6b03-4674-94b7-e33d1ff1519a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.225071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 435/871] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:38.231298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580677-bc08-4500-a272-576b74dff6ab None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.231751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580677-bc08-4500-a272-576b74dff6ab None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.231945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580677-bc08-4500-a272-576b74dff6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.257360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-cb580677-bc08-4500-a272-576b74dff6ab None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:38.258818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cb580677-bc08-4500-a272-576b74dff6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:38.291457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.333753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 437/872] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:38.357744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ece572-6b03-4674-94b7-e33d1ff1519a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:38.470951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ece572-6b03-4674-94b7-e33d1ff1519a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.506783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535c68b-f788-4569-8a34-55e202c8c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.507357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535c68b-f788-4569-8a34-55e202c8c02c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.507667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535c68b-f788-4569-8a34-55e202c8c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.507948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535c68b-f788-4569-8a34-55e202c8c02c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.519254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535c68b-f788-4569-8a34-55e202c8c02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d535c68b-f788-4569-8a34-55e202c8c02c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:38.524872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:38.525987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:38.527059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 436/873] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Aug 1 15:24:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:38.534207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580677-bc08-4500-a272-576b74dff6ab None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:38.552649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf99e19-e200-4653-b8d5-e296ed707219 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.553030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf99e19-e200-4653-b8d5-e296ed707219 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.553310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf99e19-e200-4653-b8d5-e296ed707219 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.555120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 437/874] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:38.560560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d00fb-b074-4a38-af26-3f2031b46c30 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.560846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d00fb-b074-4a38-af26-3f2031b46c30 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.561122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d00fb-b074-4a38-af26-3f2031b46c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.581934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aa8d00fb-b074-4a38-af26-3f2031b46c30 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:38.583418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aa8d00fb-b074-4a38-af26-3f2031b46c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:38.607243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.644086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580677-bc08-4500-a272-576b74dff6ab None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.671213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 438/875] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:38.684335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.684970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.685251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.685525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.686249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:38.686556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:38.687985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:38.691195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d00fb-b074-4a38-af26-3f2031b46c30 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:38.702239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 438/876] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Aug 1 15:24:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:38.708471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:38.755544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.822116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d00fb-b074-4a38-af26-3f2031b46c30 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.858907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b915b4-b381-4a85-a4e4-e53d93ce516e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.867131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341fed0-0769-4141-9577-dd462c64b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.868525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341fed0-0769-4141-9577-dd462c64b303 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.869006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341fed0-0769-4141-9577-dd462c64b303 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.869496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341fed0-0769-4141-9577-dd462c64b303 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.870591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341fed0-0769-4141-9577-dd462c64b303 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:38.872201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341fed0-0769-4141-9577-dd462c64b303 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:38.889860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 439/877] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:24:38 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:38.916432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.917592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.918077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.918566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.933283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:38.935328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:38.953243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:38.954390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:38.955344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:38.955344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:38.955344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:38.955344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:38.963195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 439/878] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:38.965026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341fed0-0769-4141-9577-dd462c64b303 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:38.984491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.089745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341fed0-0769-4141-9577-dd462c64b303 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.130257 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e214463-a704-4073-8589-7337a2c2f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.132006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e214463-a704-4073-8589-7337a2c2f35f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.132602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e214463-a704-4073-8589-7337a2c2f35f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.133187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e214463-a704-4073-8589-7337a2c2f35f None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.134315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e214463-a704-4073-8589-7337a2c2f35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:39.134948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e214463-a704-4073-8589-7337a2c2f35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.137414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e214463-a704-4073-8589-7337a2c2f35f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.160762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 440/879] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:39.166393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.212416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864761b5-05ec-4ce2-99ae-e5f60d99d474 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.212701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864761b5-05ec-4ce2-99ae-e5f60d99d474 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.213000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864761b5-05ec-4ce2-99ae-e5f60d99d474 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.214510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 441/880] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:39.219537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00943-65bc-4f83-866c-3d6e8657b46c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.219801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00943-65bc-4f83-866c-3d6e8657b46c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.220104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00943-65bc-4f83-866c-3d6e8657b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.251189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-80e00943-65bc-4f83-866c-3d6e8657b46c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:39.252705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-80e00943-65bc-4f83-866c-3d6e8657b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:39.263852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.290029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967b4e-1361-4b7c-8aa6-d64e1d9e3d51 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.327514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.328179 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.328459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.329017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.336560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 442/881] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:39.338348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.343494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:39.354803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:39.355986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:39.357110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:39.359069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 440/882] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:39.360288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00943-65bc-4f83-866c-3d6e8657b46c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.363753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.367986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.467810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00943-65bc-4f83-866c-3d6e8657b46c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.480208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d663-b3a0-4deb-80d2-a6c5326a1ca7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.517507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15149d-2fb1-4942-aa35-fa8f7b09ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.518268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15149d-2fb1-4942-aa35-fa8f7b09ec18 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.518468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15149d-2fb1-4942-aa35-fa8f7b09ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.518792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15149d-2fb1-4942-aa35-fa8f7b09ec18 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.519409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15149d-2fb1-4942-aa35-fa8f7b09ec18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.520797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15149d-2fb1-4942-aa35-fa8f7b09ec18 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.539832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.541389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.541849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.542324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.542427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 443/883] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:24:39 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:39.543431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:39.543945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.545612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.562272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.577124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 441/884] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:39.584059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15149d-2fb1-4942-aa35-fa8f7b09ec18 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.656063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.707559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15149d-2fb1-4942-aa35-fa8f7b09ec18 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.745444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822aeabf-42a9-46bf-9585-3d469b69d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.746126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aeabf-42a9-46bf-9585-3d469b69d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.746376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aeabf-42a9-46bf-9585-3d469b69d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.746621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aeabf-42a9-46bf-9585-3d469b69d3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.827963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822aeabf-42a9-46bf-9585-3d469b69d3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.829872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822aeabf-42a9-46bf-9585-3d469b69d3c1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.896241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.942282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 444/885] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:24:39.948222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.061668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d23d6-345d-4b6d-85e9-a578b923d27b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.101317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecdf1e-25a0-4528-a7a7-95a3d598e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.101976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecdf1e-25a0-4528-a7a7-95a3d598e434 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.102257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecdf1e-25a0-4528-a7a7-95a3d598e434 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.102532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecdf1e-25a0-4528-a7a7-95a3d598e434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.115006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecdf1e-25a0-4528-a7a7-95a3d598e434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.116524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecdf1e-25a0-4528-a7a7-95a3d598e434 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-77ecdf1e-25a0-4528-a7a7-95a3d598e434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:40.133066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:40.134015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:40.134889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:40.134889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:40.134889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:40.134889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:40.134889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 442/886] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:40.148540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822aeabf-42a9-46bf-9585-3d469b69d3c1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.266384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822aeabf-42a9-46bf-9585-3d469b69d3c1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.297258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d81725-4be0-444e-8f04-9f64670d5036 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.297945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d81725-4be0-444e-8f04-9f64670d5036 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.298118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d81725-4be0-444e-8f04-9f64670d5036 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.299504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 443/887] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:40.305917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f4bb4-fb90-46ef-ba70-f0e7b38c56cc None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.306196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f4bb4-fb90-46ef-ba70-f0e7b38c56cc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.306374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.306495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f4bb4-fb90-46ef-ba70-f0e7b38c56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.307167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.307675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.307994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.308773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:40.309085 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.310484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.324470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 445/888] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:40.328530 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-078f4bb4-fb90-46ef-ba70-f0e7b38c56cc None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:40.329823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-078f4bb4-fb90-46ef-ba70-f0e7b38c56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:40.329936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.354669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.384171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.415489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 444/889] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:40.435471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f4bb4-fb90-46ef-ba70-f0e7b38c56cc None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.448633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc4cdd-a76c-45f5-a193-1452956f3f55 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.488044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.488694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.488978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.489255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.497590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.499459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:40.512760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:40.513864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:40.514746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:40.514746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:40.514746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:40.514746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:40.514746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:40.514746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:40.514746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:40.514746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:40.519359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 446/890] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:40.520272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.566365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f4bb4-fb90-46ef-ba70-f0e7b38c56cc None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.608083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.608784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.609073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.609351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.610088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.611625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:40.621454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:40.623897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:40.626386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:40.628250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.628395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 445/891] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:40.635397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.650464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1399e-a643-43a8-988d-7425be0a0a8a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.681318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.693975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.694614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.694899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.695178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.696469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:40.696789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.698545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.720794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 447/892] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:40.722431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.759774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c4a6-ea3d-45e5-afb9-999ac0407167 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.805105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.805742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.806052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.806430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.807119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:40.807915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.809336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.825272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 446/893] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:40.828396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.842538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3adc9-3d18-4f39-b7df-a67f608c45f1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.888864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d485c-f58e-4633-9ff6-19a545a93400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.889476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d485c-f58e-4633-9ff6-19a545a93400 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.889792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d485c-f58e-4633-9ff6-19a545a93400 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.890098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d485c-f58e-4633-9ff6-19a545a93400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.890994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d485c-f58e-4633-9ff6-19a545a93400 None admin] RBAC: Adding query filter params (role.id=da7c5226f6924e2dbe7f1124354110e5, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=c258d2b109444c4493bcddcfd6c0d47b) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:40.891311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d485c-f58e-4633-9ff6-19a545a93400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.893459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d485c-f58e-4633-9ff6-19a545a93400 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.907953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 448/894] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/role_assignments?user.id=c258d2b109444c4493bcddcfd6c0d47b&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=da7c5226f6924e2dbe7f1124354110e5 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:40.958005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9550c-c756-44df-9aa9-927e3326379d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.966281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.007854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4cdfc-8e88-48c9-bfdd-05790de172a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.008520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4cdfc-8e88-48c9-bfdd-05790de172a5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.008802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4cdfc-8e88-48c9-bfdd-05790de172a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.009075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4cdfc-8e88-48c9-bfdd-05790de172a5 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.009836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4cdfc-8e88-48c9-bfdd-05790de172a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:41.010095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4cdfc-8e88-48c9-bfdd-05790de172a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.015408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4cdfc-8e88-48c9-bfdd-05790de172a5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.017681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 447/895] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.151404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0486b-1ecb-4b23-b04c-1b84f5f99477 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.152226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0486b-1ecb-4b23-b04c-1b84f5f99477 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.152808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0486b-1ecb-4b23-b04c-1b84f5f99477 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.154871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 449/896] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:41.160977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51489-abe8-43fa-bee2-210a3b50e502 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.161614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51489-abe8-43fa-bee2-210a3b50e502 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.162650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51489-abe8-43fa-bee2-210a3b50e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.184522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c3d51489-abe8-43fa-bee2-210a3b50e502 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:41.186301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c3d51489-abe8-43fa-bee2-210a3b50e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:41.279490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 448/897] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:41.299677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0486b-1ecb-4b23-b04c-1b84f5f99477 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.304318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.426813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0486b-1ecb-4b23-b04c-1b84f5f99477 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.465658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.466303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.466581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.466851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.467506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.468879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:41.478202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:41.479289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:41.480248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 450/898] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:41.488850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d51489-abe8-43fa-bee2-210a3b50e502 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.596951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.599843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d51489-abe8-43fa-bee2-210a3b50e502 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.638946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac006-72b1-426e-b522-b029be3e2595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.640000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac006-72b1-426e-b522-b029be3e2595 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.640530 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac006-72b1-426e-b522-b029be3e2595 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.640849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac006-72b1-426e-b522-b029be3e2595 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.641549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac006-72b1-426e-b522-b029be3e2595 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:41.641900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac006-72b1-426e-b522-b029be3e2595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.643307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac006-72b1-426e-b522-b029be3e2595 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.648862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 449/899] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.656504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.732849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.769624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87223e-2a57-4de0-ba41-a12f3e65da7e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.808152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.808779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.809108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.809392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.810074 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:41.810379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.812313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.812769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14781-effb-46b4-bc5a-240ffff93777 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.813060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14781-effb-46b4-bc5a-240ffff93777 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.813335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14781-effb-46b4-bc5a-240ffff93777 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.814668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 450/900] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:41.817861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 451/901] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.822024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05604690-8801-4fc9-a113-0c27f5a9a423 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.822304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05604690-8801-4fc9-a113-0c27f5a9a423 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.822577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05604690-8801-4fc9-a113-0c27f5a9a423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.824383 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.843320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-05604690-8801-4fc9-a113-0c27f5a9a423 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:41.845170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-05604690-8801-4fc9-a113-0c27f5a9a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:41.923348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 451/902] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:41.948204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea8ee-b92f-4e1b-9f08-629a84338155 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.950346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05604690-8801-4fc9-a113-0c27f5a9a423 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.982005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.988121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.989095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.989470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.989841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.991256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] RBAC: Adding query filter params (interface=public, service_id=e8d9cdf37bf049f2aa936ae650309e36, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:41.991809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.993438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.999406 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 452/903] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/endpoints?service_id=e8d9cdf37bf049f2aa936ae650309e36&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:42.005001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.081407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.098560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05604690-8801-4fc9-a113-0c27f5a9a423 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.122751 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6a2e5-f608-4ff6-af40-2ecbee084eb1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.138513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.139566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.140060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.140523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.141371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.143010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:42.153611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:42.154610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:42.155495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:42.158802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 452/904] 10.222.0.71 () {56 vars in 1132 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:42.165944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.168224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262cfd-6927-4edc-a967-5245abab9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.168922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262cfd-6927-4edc-a967-5245abab9135 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.169272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262cfd-6927-4edc-a967-5245abab9135 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.169614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262cfd-6927-4edc-a967-5245abab9135 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.170338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03262cfd-6927-4edc-a967-5245abab9135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.172083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03262cfd-6927-4edc-a967-5245abab9135 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.187492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 453/905] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:24:42.311088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34f270-e28d-4b4e-82da-8ee7cafe0cbd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.351707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.352340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.352629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.352906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.353588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:42.353898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.355285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.361067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 453/906] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:42.366386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262cfd-6927-4edc-a967-5245abab9135 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.434759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.482130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262cfd-6927-4edc-a967-5245abab9135 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.520928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.522430 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.522912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.523423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.524425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:42.524935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.526518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.532296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 454/907] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:42.540720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.569279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.654264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7cdbf-4996-49be-b4f4-023f8649b0fd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.690614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f346f41-6e4b-4de1-a7a9-9dfad21c43f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.691253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f346f41-6e4b-4de1-a7a9-9dfad21c43f9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.691564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f346f41-6e4b-4de1-a7a9-9dfad21c43f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.691844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f346f41-6e4b-4de1-a7a9-9dfad21c43f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.692613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f346f41-6e4b-4de1-a7a9-9dfad21c43f9 None admin] RBAC: Adding query filter params (interface=public, service_id=8f825242d6a241ee896a3d1a32c23f73, region_id=RegionOne) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:42.692928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f346f41-6e4b-4de1-a7a9-9dfad21c43f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.694947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f346f41-6e4b-4de1-a7a9-9dfad21c43f9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.700779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 454/908] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/endpoints?service_id=8f825242d6a241ee896a3d1a32c23f73&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:42.707026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.815485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ee879-aacb-4dee-9374-c7d59b420edd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.841219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.854106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a970d0b-787c-4abb-9b1b-92e1700339fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.854734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a970d0b-787c-4abb-9b1b-92e1700339fc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.855021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a970d0b-787c-4abb-9b1b-92e1700339fc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.855298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a970d0b-787c-4abb-9b1b-92e1700339fc None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.855978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a970d0b-787c-4abb-9b1b-92e1700339fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.857354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a970d0b-787c-4abb-9b1b-92e1700339fc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.867521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 455/909] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:24:43.064168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde6e1-b334-43f7-984e-3ab635bba470 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.064457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde6e1-b334-43f7-984e-3ab635bba470 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.064729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde6e1-b334-43f7-984e-3ab635bba470 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.066393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 455/910] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:43.071585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f00234-8b25-473b-8b95-26db7b7a52fa None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.072023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f00234-8b25-473b-8b95-26db7b7a52fa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.072177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f00234-8b25-473b-8b95-26db7b7a52fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.090759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-46f00234-8b25-473b-8b95-26db7b7a52fa None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:43.091977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46f00234-8b25-473b-8b95-26db7b7a52fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:43.163817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 456/911] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:43.186452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde6e1-b334-43f7-984e-3ab635bba470 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:43.270945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254874c3-a7fe-439c-8ace-6bc74cf90bd7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.271241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254874c3-a7fe-439c-8ace-6bc74cf90bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.272068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254874c3-a7fe-439c-8ace-6bc74cf90bd7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.273529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 457/912] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:43.279135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13984-31b0-4249-910f-677845ba0f01 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.279698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13984-31b0-4249-910f-677845ba0f01 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.280206 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13984-31b0-4249-910f-677845ba0f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.294522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:43.309244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-efb13984-31b0-4249-910f-677845ba0f01 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:43.311398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-efb13984-31b0-4249-910f-677845ba0f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:43.312713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde6e1-b334-43f7-984e-3ab635bba470 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.355796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac159439-8b9a-4203-8740-0031304f2880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.356360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac159439-8b9a-4203-8740-0031304f2880 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.356641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac159439-8b9a-4203-8740-0031304f2880 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.356916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac159439-8b9a-4203-8740-0031304f2880 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.371926 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac159439-8b9a-4203-8740-0031304f2880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ac159439-8b9a-4203-8740-0031304f2880 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:43.380390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:43.381916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:24:43.382735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:43.385140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 456/913] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Aug 1 15:24:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:43.391174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac159439-8b9a-4203-8740-0031304f2880 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:43.414183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 458/914] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:43.437964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb13984-31b0-4249-910f-677845ba0f01 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:43.503263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:43.517789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac159439-8b9a-4203-8740-0031304f2880 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.565140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb13984-31b0-4249-910f-677845ba0f01 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.565448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.566318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.566804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.567452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.569712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:43.570295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:43.571913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.582593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 457/915] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Aug 1 15:24:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:43.588504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:43.603112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:43.608858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df243-b920-4bed-b6af-84b344b67d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.609942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df243-b920-4bed-b6af-84b344b67d8e None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.610549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df243-b920-4bed-b6af-84b344b67d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.611019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df243-b920-4bed-b6af-84b344b67d8e None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.611940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56df243-b920-4bed-b6af-84b344b67d8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:43.613629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56df243-b920-4bed-b6af-84b344b67d8e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.633608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 459/916] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:24:43 2022] POST /identity/v3/services => generated 241 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:43.725445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4bdf2-c0c1-42c2-b39b-0ac693f9ed19 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.774315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.775422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.775941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.776431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.789552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:43.791718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:43.808368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:43.809324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:43.810220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:43.810220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:43.810220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:43.810220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:43.811047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 458/917] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:43.816835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df243-b920-4bed-b6af-84b344b67d8e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:43.926464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df243-b920-4bed-b6af-84b344b67d8e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.937144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:43.967051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.967977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.968421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.968851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.969937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:43.970394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:43.971937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.985329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 460/918] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:43.991889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.063425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:44.113058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cece1-30ef-440e-a930-a343b7f192ab None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.153685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82416f-4e93-4467-9720-152735fc3f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:44.154335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82416f-4e93-4467-9720-152735fc3f24 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.154618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82416f-4e93-4467-9720-152735fc3f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.154893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82416f-4e93-4467-9720-152735fc3f24 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.163849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82416f-4e93-4467-9720-152735fc3f24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:44.165562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82416f-4e93-4467-9720-152735fc3f24 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8d82416f-4e93-4467-9720-152735fc3f24 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:44.178624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:44.179635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:44.180667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 459/919] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:24:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:44.185919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.302324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de9fe-438d-49fa-9775-d1065d582ae5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.338870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:44.339531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.339818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.340098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.340897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:44.341210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:44.342649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:44.363392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 461/920] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:44.369217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57737e9-66bb-4562-82f8-62df9843cf4a None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.369509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57737e9-66bb-4562-82f8-62df9843cf4a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.369789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57737e9-66bb-4562-82f8-62df9843cf4a None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.371401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 460/921] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:44.372401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.376636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7842be-d595-4188-86cc-d7a0a65a9e73 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.377178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7842be-d595-4188-86cc-d7a0a65a9e73 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.377699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7842be-d595-4188-86cc-d7a0a65a9e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.396821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2c7842be-d595-4188-86cc-d7a0a65a9e73 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:44.398382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2c7842be-d595-4188-86cc-d7a0a65a9e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:44.401395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:44.490195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77ac49-82c3-4d06-a8e3-b5cf85785e49 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.499817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 461/922] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:44.516537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7842be-d595-4188-86cc-d7a0a65a9e73 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.527032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:44.527268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.527364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.527691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.539421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:44.541162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:44.556670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:44.557662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:44.558538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:44.558538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:44.558538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:44.558538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:44.558538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 462/923] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:44.563792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.580818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:44.658007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:44.658425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7842be-d595-4188-86cc-d7a0a65a9e73 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.683907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb60ca-bfc1-49e5-93d7-10c2d1c513e3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.698786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:44.699830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.700340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.700820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.701686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:44.703289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:44.714743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:44.715844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:24:44.716659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:44.719813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 462/924] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:44.722182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:44.722813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.723099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.727504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.727504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:44.727504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:44.727504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:44.727846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.741117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 463/925] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:44.748971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.840212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f636d-819f-4a21-9254-2de1c02cffd2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.859757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:44.867568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88384b-9b04-40c2-b897-795546b84c1e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.879364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:44.881497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.881996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.882475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.883358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:44.883898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:44.885571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:44.895718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 463/926] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:44.897483 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.905575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:44.906231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.906566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.906850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.914279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:44.916096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:44.922633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:44.930180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:44.931190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:44.932107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:44.932107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:44.932107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:44.932107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:44.932107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:44.932107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:44.932107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:44.932107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:44.932552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 464/927] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:44.940494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.021042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406994b4-bc4e-4f83-8793-0aba25c4c8ac None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.052839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddc8c1-6819-4b43-ab50-a92a0cd2d319 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.060265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71c6d2-a9d8-466e-9262-3264bab70d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.060896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c6d2-a9d8-466e-9262-3264bab70d6c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.061183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c6d2-a9d8-466e-9262-3264bab70d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.061462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c6d2-a9d8-466e-9262-3264bab70d6c None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.062140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71c6d2-a9d8-466e-9262-3264bab70d6c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:45.062451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71c6d2-a9d8-466e-9262-3264bab70d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.063949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71c6d2-a9d8-466e-9262-3264bab70d6c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.074176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 464/928] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:45.074176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95f6f-8d28-4185-966e-5e8cadf6e2b1 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.074176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95f6f-8d28-4185-966e-5e8cadf6e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.074176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95f6f-8d28-4185-966e-5e8cadf6e2b1 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.074176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 465/929] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:45.075669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb95f6f-8d28-4185-966e-5e8cadf6e2b1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.098517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe8ff3-4ed5-4a78-96ee-d936804572b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.099144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8ff3-4ed5-4a78-96ee-d936804572b5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.099481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8ff3-4ed5-4a78-96ee-d936804572b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.099759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8ff3-4ed5-4a78-96ee-d936804572b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.100534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe8ff3-4ed5-4a78-96ee-d936804572b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:45.100839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe8ff3-4ed5-4a78-96ee-d936804572b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.102267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe8ff3-4ed5-4a78-96ee-d936804572b5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.116692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 465/930] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:45.118354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76375c-798a-4ebc-9360-5ac21def912b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.118753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76375c-798a-4ebc-9360-5ac21def912b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.119138 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76375c-798a-4ebc-9360-5ac21def912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.129814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.140920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3b76375c-798a-4ebc-9360-5ac21def912b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:45.142136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3b76375c-798a-4ebc-9360-5ac21def912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:45.202617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb95f6f-8d28-4185-966e-5e8cadf6e2b1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.203611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.219065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 466/931] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:45.220021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76375c-798a-4ebc-9360-5ac21def912b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.263842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae7bf4-0d70-4143-a0a5-41cf3acd6eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.264812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7bf4-0d70-4143-a0a5-41cf3acd6eaf None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.265103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7bf4-0d70-4143-a0a5-41cf3acd6eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.265524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7bf4-0d70-4143-a0a5-41cf3acd6eaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.266858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae7bf4-0d70-4143-a0a5-41cf3acd6eaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.267681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae7bf4-0d70-4143-a0a5-41cf3acd6eaf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.289790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 466/932] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:24:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:24:45.290686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae7bf4-0d70-4143-a0a5-41cf3acd6eaf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.373051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76375c-798a-4ebc-9360-5ac21def912b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.401698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.418444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae7bf4-0d70-4143-a0a5-41cf3acd6eaf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.420795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171a32-d06b-426d-8d78-d38ffb309593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.421886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171a32-d06b-426d-8d78-d38ffb309593 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.422422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171a32-d06b-426d-8d78-d38ffb309593 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.422957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171a32-d06b-426d-8d78-d38ffb309593 None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/c258d2b109444c4493bcddcfd6c0d47b/roles/da7c5226f6924e2dbe7f1124354110e5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.425652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6171a32-d06b-426d-8d78-d38ffb309593 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=c258d2b109444c4493bcddcfd6c0d47b, role_id=da7c5226f6924e2dbe7f1124354110e5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.427730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6171a32-d06b-426d-8d78-d38ffb309593 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.445710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 467/933] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:24:45 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/c258d2b109444c4493bcddcfd6c0d47b/roles/da7c5226f6924e2dbe7f1124354110e5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:45.473592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.474281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.475186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.475504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.476166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.477596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:45.487765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:45.488754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:45.489604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 467/934] 10.222.0.71 () {56 vars in 1132 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:45.495188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171a32-d06b-426d-8d78-d38ffb309593 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.567401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.634298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171a32-d06b-426d-8d78-d38ffb309593 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.673852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ac80c-6a54-47ba-a73d-3cfe869821bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.674493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac80c-6a54-47ba-a73d-3cfe869821bc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.674782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac80c-6a54-47ba-a73d-3cfe869821bc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.675062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac80c-6a54-47ba-a73d-3cfe869821bc None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.675813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ac80c-6a54-47ba-a73d-3cfe869821bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:45.676121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ac80c-6a54-47ba-a73d-3cfe869821bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.677526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ac80c-6a54-47ba-a73d-3cfe869821bc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.683454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 468/935] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:45.689390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.818761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d484b86-6bad-4bb2-80f6-045c5579c151 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.857518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.858145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.858424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.858697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.859393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:45.859705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.861139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.867431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 468/936] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:45.869855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccc0e4-1d27-4b32-a05a-ce9b3de5c8ce None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.870183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccc0e4-1d27-4b32-a05a-ce9b3de5c8ce None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.870465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccc0e4-1d27-4b32-a05a-ce9b3de5c8ce None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.872260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 469/937] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:45.873353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.882547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91be0-1f16-4f6c-8b36-845bea399c98 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.883176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91be0-1f16-4f6c-8b36-845bea399c98 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.883688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91be0-1f16-4f6c-8b36-845bea399c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.897422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.907475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2cf91be0-1f16-4f6c-8b36-845bea399c98 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:45.909533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2cf91be0-1f16-4f6c-8b36-845bea399c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:45.991410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 470/938] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:45.992289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a50fc-3a6e-47d3-8f15-bde4fae760ad None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.010998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91be0-1f16-4f6c-8b36-845bea399c98 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.031395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccd962-a52d-4f04-8f6a-aab72dd4e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.032042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccd962-a52d-4f04-8f6a-aab72dd4e9d9 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.032323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccd962-a52d-4f04-8f6a-aab72dd4e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.032597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccd962-a52d-4f04-8f6a-aab72dd4e9d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.033320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccd962-a52d-4f04-8f6a-aab72dd4e9d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.034962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccd962-a52d-4f04-8f6a-aab72dd4e9d9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.062625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.068138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 469/939] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:24:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:46.143282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91be0-1f16-4f6c-8b36-845bea399c98 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.197886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.198618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.198898 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.199168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.199831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.201215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:46.212968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:46.215587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:46.217250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 471/940] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:46.226749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccd962-a52d-4f04-8f6a-aab72dd4e9d9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.322919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.354042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccd962-a52d-4f04-8f6a-aab72dd4e9d9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.392270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.392947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.393340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.393645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.394490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:46.394824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.396567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.402646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 470/941] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:46.408376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.530285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455e4f-9074-48f1-abd0-e144aee1ba0a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.532134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.569034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.569767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.570109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.570388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.571150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:46.571530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.573143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.579184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 472/942] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:46.585474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.695438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92afd-6ad2-4446-b546-941958160465 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.734135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6e962-f83f-45e1-8d98-0295eebf1687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.734790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e962-f83f-45e1-8d98-0295eebf1687 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.735147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e962-f83f-45e1-8d98-0295eebf1687 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.735465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e962-f83f-45e1-8d98-0295eebf1687 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.736459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6e962-f83f-45e1-8d98-0295eebf1687 None admin] RBAC: Adding query filter params (interface=public, service_id=fd66b677da0548b0942466298e8bcd06, region_id=RegionOne) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:46.736781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6e962-f83f-45e1-8d98-0295eebf1687 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.738959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6e962-f83f-45e1-8d98-0295eebf1687 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.746048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 471/943] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/endpoints?service_id=fd66b677da0548b0942466298e8bcd06&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:46.751607 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.871586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fe79f-8c2b-45d7-932e-7f00b0a4654f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.910468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6878932-dcff-4fc4-85bd-e82a6b01fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.911101 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878932-dcff-4fc4-85bd-e82a6b01fe52 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.911405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878932-dcff-4fc4-85bd-e82a6b01fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.911741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878932-dcff-4fc4-85bd-e82a6b01fe52 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.913213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6878932-dcff-4fc4-85bd-e82a6b01fe52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.914661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6878932-dcff-4fc4-85bd-e82a6b01fe52 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.921889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 473/944] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:24:47.526967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07643-1ecd-4cb7-ab05-5894e6cf748d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:47.527500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07643-1ecd-4cb7-ab05-5894e6cf748d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:47.527581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07643-1ecd-4cb7-ab05-5894e6cf748d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:47.529129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 472/945] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:47.534385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57070d60-f50e-45b0-a074-4b3b6bcb2e50 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:47.534796 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57070d60-f50e-45b0-a074-4b3b6bcb2e50 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:47.534967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57070d60-f50e-45b0-a074-4b3b6bcb2e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:47.554341 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-57070d60-f50e-45b0-a074-4b3b6bcb2e50 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:47.555610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-57070d60-f50e-45b0-a074-4b3b6bcb2e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:47.581144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:47.626965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 474/946] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:47.650114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07643-1ecd-4cb7-ab05-5894e6cf748d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:47.653336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:47.702904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47245db-4fab-42da-a5c1-f8654fc13147 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:47.703198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47245db-4fab-42da-a5c1-f8654fc13147 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:47.703499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47245db-4fab-42da-a5c1-f8654fc13147 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:47.705317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 475/947] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:47.712939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552939c1-8c9a-420a-bf8b-bb868beaab20 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:47.713243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552939c1-8c9a-420a-bf8b-bb868beaab20 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:47.713653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552939c1-8c9a-420a-bf8b-bb868beaab20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:47.737300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-552939c1-8c9a-420a-bf8b-bb868beaab20 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:47.738494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-552939c1-8c9a-420a-bf8b-bb868beaab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:47.777126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07643-1ecd-4cb7-ab05-5894e6cf748d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:47.824441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:47.825626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:47.826088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:47.826514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:47.827388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:47.829517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:47.833772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING keystone.server.flask.common [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 15:24:47.847538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 476/948] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:47.858072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.sql.core [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:24:47.858072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 15:24:47.858072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [parameters: {'id': '1463cf3a0f8b45f2b80cfe24531b8ed0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 15:24:47.858072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80434) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:24:47.871539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552939c1-8c9a-420a-bf8b-bb868beaab20 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1463cf3a0f8b45f2b80cfe24531b8ed0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1463cf3a0f8b45f2b80cfe24531b8ed0. Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:24:47.878670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application result.read() Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 01 15:24:47.879714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application yield resource Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise self.value Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application session.commit() Aug 01 15:24:47.881505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:24:47.882754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:24:47.883888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application result.read() Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:24:47.884906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [parameters: {'id': '1463cf3a0f8b45f2b80cfe24531b8ed0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:47.886028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:47.887022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1463cf3a0f8b45f2b80cfe24531b8ed0. Aug 01 15:24:47.888544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:47.891695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 473/949] 10.222.0.71 () {60 vars in 1140 bytes} [Mon Aug 1 15:24:47 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:47.899687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:47.992031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.006454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.022950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552939c1-8c9a-420a-bf8b-bb868beaab20 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.041605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811160ca-1851-47a9-af09-adb421bb470d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.068682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc3488-1a6c-4511-92e4-45695dd79288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.069992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc3488-1a6c-4511-92e4-45695dd79288 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.070344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc3488-1a6c-4511-92e4-45695dd79288 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.070951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc3488-1a6c-4511-92e4-45695dd79288 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.089202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.089415 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc3488-1a6c-4511-92e4-45695dd79288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:48.089870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.090156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.090437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-34bc3488-1a6c-4511-92e4-45695dd79288 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:48.094685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:48.095625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:48.096572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 477/950] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Aug 1 15:24:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:48.100542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.100542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.104491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc3488-1a6c-4511-92e4-45695dd79288 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:48.115612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:48.117095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:48.118315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 474/951] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:48.122845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.225022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc3488-1a6c-4511-92e4-45695dd79288 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.237258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465311-e50e-42e0-8920-3b13d813052a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.257492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.267685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.268681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.269245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.269718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.270897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:48.271679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.273359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.276209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1defe8-2861-4697-bda4-224c1819412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.276829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1defe8-2861-4697-bda4-224c1819412f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.277117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1defe8-2861-4697-bda4-224c1819412f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.277399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1defe8-2861-4697-bda4-224c1819412f None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.278127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1defe8-2861-4697-bda4-224c1819412f None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:48.278427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1defe8-2861-4697-bda4-224c1819412f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.279888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1defe8-2861-4697-bda4-224c1819412f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.288972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 478/952] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:48.290105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.301512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 475/953] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:48.303490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bea60f-3910-47cb-a859-3697803cb965 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.303791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bea60f-3910-47cb-a859-3697803cb965 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.304078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bea60f-3910-47cb-a859-3697803cb965 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.305344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 476/954] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:48.311307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da33c02-5ec2-45f7-875d-5455ac4042ad None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.311749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da33c02-5ec2-45f7-875d-5455ac4042ad None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.311936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da33c02-5ec2-45f7-875d-5455ac4042ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.313954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.336599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7da33c02-5ec2-45f7-875d-5455ac4042ad None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:48.338033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7da33c02-5ec2-45f7-875d-5455ac4042ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:48.420486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24c5ab-047d-4b55-a4bc-95e667ffa7f5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.426412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 477/955] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:48.442480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da33c02-5ec2-45f7-875d-5455ac4042ad None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.462578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.463776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.464311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.464899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.477530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.479228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:48.496174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:48.497195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:48.498186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:48.498186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:48.498186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:48.498186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:48.498186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 479/956] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:48.503616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.568102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da33c02-5ec2-45f7-875d-5455ac4042ad None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.578824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.591694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.608339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.608994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.609272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.609544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.610360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.611779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:48.621781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:48.622868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:48.623755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 478/957] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:48.629396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.648657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d24c-95ec-4794-b76f-68a8884c4969 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.691677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.692767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.693348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.693928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.694697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:48.695006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.696426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.712366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 480/958] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:48.717957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.762805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc1520-6c25-4f2c-811e-70a4ef724cc9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.810062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.811481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.812218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.812719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.813882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:48.814929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.817057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.824609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 479/959] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:48.830089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.841325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d360eed-aa0e-4683-ab64-9f6502f08960 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.872699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.877431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.900386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.901532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.901868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.902145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.915135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.918158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:48.935035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:48.936111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:24:48.937045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:48.941801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 481/960] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:48.942791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.951163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bb85c-91c2-4a63-924a-85453047ce06 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.988452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdbea3-1665-4b40-8a68-44d2e0a08094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.989080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdbea3-1665-4b40-8a68-44d2e0a08094 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.989360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdbea3-1665-4b40-8a68-44d2e0a08094 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.989633 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdbea3-1665-4b40-8a68-44d2e0a08094 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.990344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdbea3-1665-4b40-8a68-44d2e0a08094 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:48.990646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdbea3-1665-4b40-8a68-44d2e0a08094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.992164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdbea3-1665-4b40-8a68-44d2e0a08094 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.997441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 480/961] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:49.024913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1f4c0-cfc1-4b44-b47d-c83d52a7e5f7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.025292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1f4c0-cfc1-4b44-b47d-c83d52a7e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.025639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1f4c0-cfc1-4b44-b47d-c83d52a7e5f7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.027544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 481/962] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:49.034561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16893-14a0-411d-bce4-306f2950ca3a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.034561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16893-14a0-411d-bce4-306f2950ca3a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.034561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16893-14a0-411d-bce4-306f2950ca3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.056093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-61e16893-14a0-411d-bce4-306f2950ca3a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:49.057474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-61e16893-14a0-411d-bce4-306f2950ca3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:49.069734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e2dca-c5a8-4b23-8f7b-08a3f125b98d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.107988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.108891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.109334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.109772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.110744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:49.111209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.112852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.132943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 482/963] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:49.143400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 482/964] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:49.144738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.164904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e16893-14a0-411d-bce4-306f2950ca3a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.206931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.210748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.270698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb289ec4-9f6c-40f7-936d-2329e55418f0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.286779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e16893-14a0-411d-bce4-306f2950ca3a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.312000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee8ec1-0ee0-4365-9b1b-970b8b231252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.312633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8ec1-0ee0-4365-9b1b-970b8b231252 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.312964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8ec1-0ee0-4365-9b1b-970b8b231252 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.313176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8ec1-0ee0-4365-9b1b-970b8b231252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.330848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.332012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.332315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.332581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.333279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.335007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:49.346368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:49.347445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:49.348262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:49.351459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 483/965] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:49.354218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.420719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee8ec1-0ee0-4365-9b1b-970b8b231252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.422765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee8ec1-0ee0-4365-9b1b-970b8b231252 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.478571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.492268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.503045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934f5af-f930-4f50-a6a6-87f8b74fcfd7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.545857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 483/966] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:24:49.546250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.546750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.547045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.547315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.548041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:49.548346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.549778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.552745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee8ec1-0ee0-4365-9b1b-970b8b231252 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.559454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 484/967] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:49.561244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.671520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee8ec1-0ee0-4365-9b1b-970b8b231252 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.683115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03faaa6-2146-4d9e-bd7b-28c6a51ed743 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.711039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.712149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.712629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.713071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.720978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.721615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.721900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.722178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.723114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:49.723273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.724737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.725583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.727462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.735561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 485/968] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:49.735737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.736660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:49.757822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:49.758792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:49.759730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:49.759730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:49.759730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:49.759730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:49.760495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 484/969] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:49.767289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.769165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.853688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae609b-de2a-48e5-a353-d27e51ea1084 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.883694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb451f-85cf-435e-a2c7-e37ad40724e6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.889489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b59a-9716-499d-a735-1d47546225c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.890350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b59a-9716-499d-a735-1d47546225c0 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.890734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b59a-9716-499d-a735-1d47546225c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.891154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b59a-9716-499d-a735-1d47546225c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.892029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72b59a-9716-499d-a735-1d47546225c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.893625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72b59a-9716-499d-a735-1d47546225c0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.927529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 486/970] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:24:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:49.942599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.943397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.943803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.944087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.944849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:49.945165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.946823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.962969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 485/971] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:49.968741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b59a-9716-499d-a735-1d47546225c0 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.065734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:50.093455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b59a-9716-499d-a735-1d47546225c0 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.141715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.142386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.142697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.142977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.153346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.155007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:24:50.168237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:50.169190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:50.170072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 487/972] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:50.175597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.242407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:50.300436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a2ce-d5f2-40b8-a386-58c3d816b724 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.343950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6b08-5f52-4759-879c-93f1e2ca3e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.344578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6b08-5f52-4759-879c-93f1e2ca3e66 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.344858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6b08-5f52-4759-879c-93f1e2ca3e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.345132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6b08-5f52-4759-879c-93f1e2ca3e66 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.345885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6b08-5f52-4759-879c-93f1e2ca3e66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:50.346253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6b08-5f52-4759-879c-93f1e2ca3e66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.347735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6b08-5f52-4759-879c-93f1e2ca3e66 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.360432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 486/973] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:50.366980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.485615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969ed67-7f49-4b16-ae69-e0f6b59c21c3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.524363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef9c87-5f86-44c1-a59c-79b95170d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.525123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9c87-5f86-44c1-a59c-79b95170d365 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.525474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9c87-5f86-44c1-a59c-79b95170d365 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.525823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9c87-5f86-44c1-a59c-79b95170d365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.526703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9c87-5f86-44c1-a59c-79b95170d365 None admin] RBAC: Adding query filter params (role.id=da7c5226f6924e2dbe7f1124354110e5, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=c258d2b109444c4493bcddcfd6c0d47b) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:50.527024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9c87-5f86-44c1-a59c-79b95170d365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.528802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9c87-5f86-44c1-a59c-79b95170d365 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.537657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 488/974] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:24:50 2022] GET /identity/v3/role_assignments?user.id=c258d2b109444c4493bcddcfd6c0d47b&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=da7c5226f6924e2dbe7f1124354110e5 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:50.615573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932dcc-bb4d-4b3a-bc25-4b1156e0a8fa None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.615918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932dcc-bb4d-4b3a-bc25-4b1156e0a8fa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.616137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932dcc-bb4d-4b3a-bc25-4b1156e0a8fa None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.617931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 487/975] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:50.624549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3047cb-f9c2-46b9-ac53-da8d9705c505 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.624911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3047cb-f9c2-46b9-ac53-da8d9705c505 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.625477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3047cb-f9c2-46b9-ac53-da8d9705c505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.632745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:50.647522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5b3047cb-f9c2-46b9-ac53-da8d9705c505 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:50.648859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5b3047cb-f9c2-46b9-ac53-da8d9705c505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:50.733626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 489/976] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:50.758477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5932dcc-bb4d-4b3a-bc25-4b1156e0a8fa None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.875032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5932dcc-bb4d-4b3a-bc25-4b1156e0a8fa None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.889465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:50.918817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.919467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.919750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.920022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.920713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.922444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.925221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING keystone.server.flask.common [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 15:24:50.940839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.sql.core [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:24:50.940839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 15:24:50.940839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [parameters: {'user_id': '5968ac089c444535a612ff967f4d58b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 15:24:50.940839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80435) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Aug 01 15:24:50.949850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:24:50.950718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application yield resource Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise self.value Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application session.commit() Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:24:50.951710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:24:50.952771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:24:50.953968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:24:50.954795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [parameters: {'user_id': '5968ac089c444535a612ff967f4d58b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:50.956910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 01 15:24:50.958813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 01 15:24:50.960848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 01 15:24:50.960848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 01 15:24:50.960848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:24:50.960848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:24:50.960848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 15:24:50.960848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:50.960848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 488/977] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Aug 1 15:24:50 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:50.961325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3047cb-f9c2-46b9-ac53-da8d9705c505 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:51.073747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3047cb-f9c2-46b9-ac53-da8d9705c505 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:51.107260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:51.113005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b3806-10c3-4e3a-812e-ae2fc5676532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:51.113665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3806-10c3-4e3a-812e-ae2fc5676532 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.114000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3806-10c3-4e3a-812e-ae2fc5676532 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.114282 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3806-10c3-4e3a-812e-ae2fc5676532 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.122447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b3806-10c3-4e3a-812e-ae2fc5676532 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:51.124097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b3806-10c3-4e3a-812e-ae2fc5676532 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-848b3806-10c3-4e3a-812e-ae2fc5676532 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:24:51.137405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:51.139439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:51.141661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 490/978] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:24:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:51.144489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:51.209428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9333-1094-4c16-9c6a-188ec80733c2 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.209767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9333-1094-4c16-9c6a-188ec80733c2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.209972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9333-1094-4c16-9c6a-188ec80733c2 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.211863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 491/979] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:51.216714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ec999-3a37-4522-a2af-c8d8f2fd5c1c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.217002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ec999-3a37-4522-a2af-c8d8f2fd5c1c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.217283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ec999-3a37-4522-a2af-c8d8f2fd5c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.245570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-be2ec999-3a37-4522-a2af-c8d8f2fd5c1c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:51.246769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-be2ec999-3a37-4522-a2af-c8d8f2fd5c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:51.264522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e187a42-7c60-49d2-be97-c9335915df2c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:51.301979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed060-6465-4638-9a6b-b84020196a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:51.303048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed060-6465-4638-9a6b-b84020196a8a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.303587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed060-6465-4638-9a6b-b84020196a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.304092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed060-6465-4638-9a6b-b84020196a8a None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.305078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaed060-6465-4638-9a6b-b84020196a8a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:51.305623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaed060-6465-4638-9a6b-b84020196a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:51.307487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaed060-6465-4638-9a6b-b84020196a8a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:51.327406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 492/980] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:51.346245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ec999-3a37-4522-a2af-c8d8f2fd5c1c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:51.357103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 489/981] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:51.473255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ec999-3a37-4522-a2af-c8d8f2fd5c1c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:51.501362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:51.515002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219810b-fbce-4417-a253-0e9297127e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:51.515669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219810b-fbce-4417-a253-0e9297127e57 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.515952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219810b-fbce-4417-a253-0e9297127e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.516231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219810b-fbce-4417-a253-0e9297127e57 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.516934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219810b-fbce-4417-a253-0e9297127e57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:51.518324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219810b-fbce-4417-a253-0e9297127e57 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:51.536238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 493/982] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:24:51 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:24:52.087198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bec2b2-7057-4743-a73f-a25d21069bdf None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.087776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bec2b2-7057-4743-a73f-a25d21069bdf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.087776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bec2b2-7057-4743-a73f-a25d21069bdf None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.089174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 490/983] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:52.094538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3c0f-72e7-447e-be55-46d5e574cbde None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.095147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3c0f-72e7-447e-be55-46d5e574cbde None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.095147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3c0f-72e7-447e-be55-46d5e574cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.114147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ac7b3c0f-72e7-447e-be55-46d5e574cbde None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:52.115875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ac7b3c0f-72e7-447e-be55-46d5e574cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:52.195350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 494/984] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:52.218667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bec2b2-7057-4743-a73f-a25d21069bdf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.265988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.347982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bec2b2-7057-4743-a73f-a25d21069bdf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.383137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.383805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.384085 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.384356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.384969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.386325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:52.395234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:52.396235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:52.397078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:52.398556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 491/985] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:52.402591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b3c0f-72e7-447e-be55-46d5e574cbde None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.508262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b3c0f-72e7-447e-be55-46d5e574cbde None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.519158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.551727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2c529-b75b-4d5b-8db1-cd617728cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.552357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2c529-b75b-4d5b-8db1-cd617728cec2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.552635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2c529-b75b-4d5b-8db1-cd617728cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.552901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2c529-b75b-4d5b-8db1-cd617728cec2 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.553571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2c529-b75b-4d5b-8db1-cd617728cec2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:52.553871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2c529-b75b-4d5b-8db1-cd617728cec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.555240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2c529-b75b-4d5b-8db1-cd617728cec2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:52.560518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 495/986] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:52.566079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.671752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.680707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4aab-d9b1-4607-95e6-5ba19a87ee85 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.719307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.720366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.720853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.721329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.722232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:52.722738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.724384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:52.730106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 492/987] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:52.734675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063cf54-b2de-4cbc-a570-49ac09f8b516 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.734973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063cf54-b2de-4cbc-a570-49ac09f8b516 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.735241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063cf54-b2de-4cbc-a570-49ac09f8b516 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.736277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.736857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 496/988] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:52.742153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4dc3b-dd14-4d42-920e-e19d0573af64 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.742437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4dc3b-dd14-4d42-920e-e19d0573af64 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.742720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4dc3b-dd14-4d42-920e-e19d0573af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.762847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f5d4dc3b-dd14-4d42-920e-e19d0573af64 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:52.764087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f5d4dc3b-dd14-4d42-920e-e19d0573af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:52.842194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 497/989] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:52.852994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a085-bd9c-4030-ade3-d951fdb8fba9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.864244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4dc3b-dd14-4d42-920e-e19d0573af64 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.890209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.890833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.891111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.891400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.892164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] RBAC: Adding query filter params (interface=admin, service_id=fd66b677da0548b0942466298e8bcd06, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:52.892471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.893841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:52.904298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 493/990] 10.222.0.71 () {56 vars in 1249 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/endpoints?service_id=fd66b677da0548b0942466298e8bcd06&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:52.906582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.934170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.978000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4dc3b-dd14-4d42-920e-e19d0573af64 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.979582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.018150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.018787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b773f-3cd5-454b-80ca-8a13fb546742 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.019026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.019336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.019753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.020413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.022329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:53.032215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:53.033569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:53.034592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 498/991] 10.222.0.71 () {56 vars in 1105 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:53.039953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.058329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1192-bfd8-448f-af28-729d0ec95002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.058954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1192-bfd8-448f-af28-729d0ec95002 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.059240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1192-bfd8-448f-af28-729d0ec95002 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.059555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1192-bfd8-448f-af28-729d0ec95002 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.060210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec1192-bfd8-448f-af28-729d0ec95002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.061573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec1192-bfd8-448f-af28-729d0ec95002 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.069319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 494/992] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:24:53.158306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f4c1-1d4a-42c6-943b-3bce43d42dd2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.197505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7554d-e321-4757-999b-2af708167231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.198466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7554d-e321-4757-999b-2af708167231 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.198950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7554d-e321-4757-999b-2af708167231 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.199427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7554d-e321-4757-999b-2af708167231 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.200506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7554d-e321-4757-999b-2af708167231 None admin] RBAC: Adding query filter params (name=image) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:53.201000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7554d-e321-4757-999b-2af708167231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.202593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7554d-e321-4757-999b-2af708167231 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.215199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 499/993] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:53.216300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1192-bfd8-448f-af28-729d0ec95002 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.317751 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.335282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1192-bfd8-448f-af28-729d0ec95002 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.374622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdaaab-6438-475c-86fe-749c3997ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.375244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdaaab-6438-475c-86fe-749c3997ce36 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.375624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdaaab-6438-475c-86fe-749c3997ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.375903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdaaab-6438-475c-86fe-749c3997ce36 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.376574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdaaab-6438-475c-86fe-749c3997ce36 None admin] RBAC: Adding query filter params (type=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:53.376876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdaaab-6438-475c-86fe-749c3997ce36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.378248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdaaab-6438-475c-86fe-749c3997ce36 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.383528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 495/994] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:53.601560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898a3b-5266-49d6-9ef8-3d9d919568a6 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.601926 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898a3b-5266-49d6-9ef8-3d9d919568a6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.602129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898a3b-5266-49d6-9ef8-3d9d919568a6 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.603644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 500/995] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:53.608684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09748458-1436-4686-bfca-f0d37789cf77 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.608976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09748458-1436-4686-bfca-f0d37789cf77 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.609255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09748458-1436-4686-bfca-f0d37789cf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.629770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-09748458-1436-4686-bfca-f0d37789cf77 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:53.631882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-09748458-1436-4686-bfca-f0d37789cf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:53.705393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 496/996] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:53.729359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84898a3b-5266-49d6-9ef8-3d9d919568a6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.765928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.865470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84898a3b-5266-49d6-9ef8-3d9d919568a6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.905970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.906722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.907076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.907463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.909170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.909939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:53.923152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:53.925022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:53.926031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:24:53.928304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 501/997] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:53.932139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09748458-1436-4686-bfca-f0d37789cf77 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:54.016676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:54.038338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09748458-1436-4686-bfca-f0d37789cf77 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.074324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.074949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.075290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.075608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.076288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:54.076594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.077974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.088375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 497/998] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:54.089425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:54.196692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:54.205897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4932-7f28-4f0b-9faa-90a80ac6ab88 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.251343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.251832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.251832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.251996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.252654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:54.253025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.254377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.265820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 502/999] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:54.272622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:54.391418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb2886-033b-4322-b0af-1bea0d7e94b2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.429753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58027bca-770c-4bba-a960-d8b0af32c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.430384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58027bca-770c-4bba-a960-d8b0af32c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.430666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58027bca-770c-4bba-a960-d8b0af32c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.430940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58027bca-770c-4bba-a960-d8b0af32c9e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.431937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58027bca-770c-4bba-a960-d8b0af32c9e0 None admin] RBAC: Adding query filter params (interface=public, service_id=c277856599454e7cbdd95e2121339b7a, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:54.432335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58027bca-770c-4bba-a960-d8b0af32c9e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.433930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58027bca-770c-4bba-a960-d8b0af32c9e0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.439820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 498/1000] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Aug 1 15:24:54 2022] GET /identity/v3/endpoints?service_id=c277856599454e7cbdd95e2121339b7a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:54.445339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:54.573010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e8685-3be2-4e51-8b17-d21395bc9f8a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.608456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2bc5-135f-4392-ad0c-b398b53b3076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.609076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2bc5-135f-4392-ad0c-b398b53b3076 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.609356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2bc5-135f-4392-ad0c-b398b53b3076 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.609821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2bc5-135f-4392-ad0c-b398b53b3076 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.610546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2bc5-135f-4392-ad0c-b398b53b3076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.611827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2bc5-135f-4392-ad0c-b398b53b3076 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.623601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 503/1001] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:24:54 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:24:55.132849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0711df-977d-49cf-aa84-6ba85bcf08fc None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.133243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0711df-977d-49cf-aa84-6ba85bcf08fc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.133421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0711df-977d-49cf-aa84-6ba85bcf08fc None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.134887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 499/1002] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:55.140459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e480-084f-443f-969e-c9e96678fb16 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.140755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e480-084f-443f-969e-c9e96678fb16 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.141031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e480-084f-443f-969e-c9e96678fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.159042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b3b7e480-084f-443f-969e-c9e96678fb16 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:55.160247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b3b7e480-084f-443f-969e-c9e96678fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:55.178292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:55.235417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 504/1003] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:55.256747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0711df-977d-49cf-aa84-6ba85bcf08fc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:55.268256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:55.364959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0711df-977d-49cf-aa84-6ba85bcf08fc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:55.403882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:55.404441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.404719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.404989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.405611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:55.406984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:55.410727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2885bc-3985-4523-a59f-fac9855d5600 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.411030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2885bc-3985-4523-a59f-fac9855d5600 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.411311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2885bc-3985-4523-a59f-fac9855d5600 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.413460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 505/1004] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:55.417153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:55.418100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:24:55.423863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:55.424581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30439-7c0c-406b-8773-2f98be19f1fa None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.424667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 500/1005] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Aug 1 15:24:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:55.424742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30439-7c0c-406b-8773-2f98be19f1fa None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.424742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30439-7c0c-406b-8773-2f98be19f1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.426534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:55.438571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c1c30439-7c0c-406b-8773-2f98be19f1fa None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:55.439741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c1c30439-7c0c-406b-8773-2f98be19f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:55.504440 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:55.510434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 506/1006] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:55.532246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30439-7c0c-406b-8773-2f98be19f1fa None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:55.533959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b565c5-2d45-484b-be10-c7b0a66523f7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:55.570324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:55.570946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.571233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.571542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.572218 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:55.572522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:55.573891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:55.579723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 501/1007] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:55.585445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:55.622873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:55.644905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30439-7c0c-406b-8773-2f98be19f1fa None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:55.681135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f476b-008b-4a5f-9260-0b56115e7c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:55.681680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f476b-008b-4a5f-9260-0b56115e7c30 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.681965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f476b-008b-4a5f-9260-0b56115e7c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.682244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f476b-008b-4a5f-9260-0b56115e7c30 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.682951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f476b-008b-4a5f-9260-0b56115e7c30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:55.684345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f476b-008b-4a5f-9260-0b56115e7c30 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:55.697462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928fe7b-ecb7-4ca1-80cb-1a6c63468bc7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:55.704888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 507/1008] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:24:55 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:55.742007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:55.748584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f6ea5-55a7-4cc3-8c45-00ec26be4c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:55.749238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f6ea5-55a7-4cc3-8c45-00ec26be4c28 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.749512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f6ea5-55a7-4cc3-8c45-00ec26be4c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.749786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f6ea5-55a7-4cc3-8c45-00ec26be4c28 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.750506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f6ea5-55a7-4cc3-8c45-00ec26be4c28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:55.750798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f6ea5-55a7-4cc3-8c45-00ec26be4c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:55.752309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f6ea5-55a7-4cc3-8c45-00ec26be4c28 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:55.758338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 502/1009] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Aug 1 15:24:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:55.764434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f476b-008b-4a5f-9260-0b56115e7c30 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:55.883717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f476b-008b-4a5f-9260-0b56115e7c30 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:55.924135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4283d4c-7f6f-424a-96cc-b00a8166e506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:55.924774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283d4c-7f6f-424a-96cc-b00a8166e506 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.925057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283d4c-7f6f-424a-96cc-b00a8166e506 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.925334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283d4c-7f6f-424a-96cc-b00a8166e506 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.926070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4283d4c-7f6f-424a-96cc-b00a8166e506 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:55.927506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4283d4c-7f6f-424a-96cc-b00a8166e506 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:55.945324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 508/1010] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:24:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:56.698603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3135a4-2760-4389-8bee-cc209c676415 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.699130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3135a4-2760-4389-8bee-cc209c676415 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.699130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3135a4-2760-4389-8bee-cc209c676415 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.700744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 503/1011] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:56.706156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2d24e-05ad-451b-8367-4d6d2c520e81 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.706656 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2d24e-05ad-451b-8367-4d6d2c520e81 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.706733 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2d24e-05ad-451b-8367-4d6d2c520e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.714442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:56.729171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-90b2d24e-05ad-451b-8367-4d6d2c520e81 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:56.730920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-90b2d24e-05ad-451b-8367-4d6d2c520e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:56.824617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 509/1012] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:56 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:56.846869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3135a4-2760-4389-8bee-cc209c676415 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.970099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3135a4-2760-4389-8bee-cc209c676415 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.022976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.023928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.024412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.024899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.026033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:57.028495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:57.038988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:57.040077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:57.041320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 504/1013] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:24:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:57.047080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2d24e-05ad-451b-8367-4d6d2c520e81 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:57.160304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2d24e-05ad-451b-8367-4d6d2c520e81 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.194941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.204523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.205231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.205526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.205813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.206564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] RBAC: Adding query filter params (name=compute) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:57.206919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:57.208341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.215720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 510/1014] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:57.221522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:57.305207 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.370514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62645e4a-2ab4-4b94-baee-ec8383a9caa7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.410422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d59fc0-6799-4f8e-85eb-2e935d027db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.411499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59fc0-6799-4f8e-85eb-2e935d027db6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.411989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59fc0-6799-4f8e-85eb-2e935d027db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.412461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59fc0-6799-4f8e-85eb-2e935d027db6 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.413469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d59fc0-6799-4f8e-85eb-2e935d027db6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:57.413967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d59fc0-6799-4f8e-85eb-2e935d027db6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:57.416506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d59fc0-6799-4f8e-85eb-2e935d027db6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.424969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 505/1015] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Aug 1 15:24:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:57.431429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:57.559880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea06de-9d12-4639-a9a4-1c47ee413bee None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.604226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcba4a-77d7-4d2b-be26-42106f61617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.605088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcba4a-77d7-4d2b-be26-42106f61617f None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.605563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcba4a-77d7-4d2b-be26-42106f61617f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.606025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcba4a-77d7-4d2b-be26-42106f61617f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.606987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcba4a-77d7-4d2b-be26-42106f61617f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:57.608437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcba4a-77d7-4d2b-be26-42106f61617f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.635757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 511/1016] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:24:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:57.800555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7902-04a4-41c1-935a-28c4745470ad None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.801066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7902-04a4-41c1-935a-28c4745470ad None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.801168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7902-04a4-41c1-935a-28c4745470ad None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.802658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 506/1017] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:57.808106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2755fd-9cf2-48ed-8497-71da5eee5a4b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.808601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2755fd-9cf2-48ed-8497-71da5eee5a4b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.808681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2755fd-9cf2-48ed-8497-71da5eee5a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.830286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9e2755fd-9cf2-48ed-8497-71da5eee5a4b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:57.831464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9e2755fd-9cf2-48ed-8497-71da5eee5a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:57.889878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.931729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 512/1018] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:57.954655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb7902-04a4-41c1-935a-28c4745470ad None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.031326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e0a9-f208-4a03-81e5-bc0f45e9b588 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.031642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e0a9-f208-4a03-81e5-bc0f45e9b588 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.031910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e0a9-f208-4a03-81e5-bc0f45e9b588 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.033415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 513/1019] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:24:58.038299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83586bcd-960f-4b12-aa5b-49e0cd3b9a51 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.038581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83586bcd-960f-4b12-aa5b-49e0cd3b9a51 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.038854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83586bcd-960f-4b12-aa5b-49e0cd3b9a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.057506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-83586bcd-960f-4b12-aa5b-49e0cd3b9a51 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:58.058674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-83586bcd-960f-4b12-aa5b-49e0cd3b9a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:58.064996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb7902-04a4-41c1-935a-28c4745470ad None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.091401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:58.104754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.105410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.105695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.105969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.106595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.108454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:58.118929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:58.120315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:24:58.121471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:24:58.125426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 507/1020] 10.222.0.71 () {56 vars in 1105 bytes} [Mon Aug 1 15:24:57 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:58.126027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.138780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 514/1021] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:24:58.162345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83586bcd-960f-4b12-aa5b-49e0cd3b9a51 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.240649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b1dc-773f-4783-bb88-a7e8421c6ff3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.277777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83586bcd-960f-4b12-aa5b-49e0cd3b9a51 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.280979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:58.283076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.283825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.284183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.284461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.285151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] RBAC: Adding query filter params (name=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:58.285457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.286880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.292698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 508/1022] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:58.298357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.319102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eabf5e-27c9-4c9b-aed9-2dc46d59b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.319843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eabf5e-27c9-4c9b-aed9-2dc46d59b28a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.320085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eabf5e-27c9-4c9b-aed9-2dc46d59b28a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.320330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eabf5e-27c9-4c9b-aed9-2dc46d59b28a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.321486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eabf5e-27c9-4c9b-aed9-2dc46d59b28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.323125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eabf5e-27c9-4c9b-aed9-2dc46d59b28a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.324711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 515/1023] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:58.330203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eabf5e-27c9-4c9b-aed9-2dc46d59b28a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.358827 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:58.416486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174c532-6065-4896-a73e-18fbc476cf22 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.450016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eabf5e-27c9-4c9b-aed9-2dc46d59b28a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.454378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.455011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.455298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.455691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.456374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] RBAC: Adding query filter params (type=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:58.456686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.458071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.464757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 509/1024] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:24:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:58.470739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.492651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f94e7-0c3a-4aeb-a125-342840fdef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.493284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f94e7-0c3a-4aeb-a125-342840fdef12 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.493607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f94e7-0c3a-4aeb-a125-342840fdef12 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.493841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f94e7-0c3a-4aeb-a125-342840fdef12 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.494523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f94e7-0c3a-4aeb-a125-342840fdef12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.496038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f94e7-0c3a-4aeb-a125-342840fdef12 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.524206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 516/1025] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:24:58 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:24:58.587979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5093a8e-bf80-4a29-93ad-40f3add5a289 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.606654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:58.628226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d0790-5160-4524-9e89-11f64a5f6161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.628815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0790-5160-4524-9e89-11f64a5f6161 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.629068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0790-5160-4524-9e89-11f64a5f6161 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.629348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0790-5160-4524-9e89-11f64a5f6161 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.630122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d0790-5160-4524-9e89-11f64a5f6161 None admin] RBAC: Adding query filter params (interface=public, service_id=f2d9b31353234fe3985a867ae76168bf, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:58.630496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d0790-5160-4524-9e89-11f64a5f6161 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.631983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d0790-5160-4524-9e89-11f64a5f6161 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.642625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 510/1026] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Aug 1 15:24:58 2022] GET /identity/v3/endpoints?service_id=f2d9b31353234fe3985a867ae76168bf&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:58.643540 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f94e7-0c3a-4aeb-a125-342840fdef12 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.672778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:58.766762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f94e7-0c3a-4aeb-a125-342840fdef12 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.804222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da23fa-122f-42b1-910c-214806034c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.804852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da23fa-122f-42b1-910c-214806034c98 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.805199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da23fa-122f-42b1-910c-214806034c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.805524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da23fa-122f-42b1-910c-214806034c98 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.806363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da23fa-122f-42b1-910c-214806034c98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.807799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da23fa-122f-42b1-910c-214806034c98 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.823428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 517/1027] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:24:58 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:24:59.790920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ca1b-bc9e-4bde-b5eb-a1cdb945d01e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.791503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ca1b-bc9e-4bde-b5eb-a1cdb945d01e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.791503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ca1b-bc9e-4bde-b5eb-a1cdb945d01e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.792987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 511/1028] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:24:59.798022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762b09a-c00a-46ef-81f7-0940505a816b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.798319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762b09a-c00a-46ef-81f7-0940505a816b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.798602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762b09a-c00a-46ef-81f7-0940505a816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.817099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8762b09a-c00a-46ef-81f7-0940505a816b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:59.818912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8762b09a-c00a-46ef-81f7-0940505a816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:59.891152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 518/1029] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:24:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:59.914378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080ca1b-bc9e-4bde-b5eb-a1cdb945d01e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:00.022216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080ca1b-bc9e-4bde-b5eb-a1cdb945d01e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:00.058141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa364ae-ca70-4129-b15b-a8cd365df838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:00.058708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa364ae-ca70-4129-b15b-a8cd365df838 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.058990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa364ae-ca70-4129-b15b-a8cd365df838 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.059265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa364ae-ca70-4129-b15b-a8cd365df838 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.069359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa364ae-ca70-4129-b15b-a8cd365df838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-dfa364ae-ca70-4129-b15b-a8cd365df838 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:00.074479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:00.076179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:25:00.077039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:00.079454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 512/1030] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Aug 1 15:24:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:00.082360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762b09a-c00a-46ef-81f7-0940505a816b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:00.102118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:00.187334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762b09a-c00a-46ef-81f7-0940505a816b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:00.222232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:00.222860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.223191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.223488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.224251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:00.225060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:00.226426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:00.239064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 519/1031] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Aug 1 15:25:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:00.246099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa364ae-ca70-4129-b15b-a8cd365df838 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:00.293897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:00.361722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa364ae-ca70-4129-b15b-a8cd365df838 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:00.402629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:00.403281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.403593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.403870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.414989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:00.416740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:00.432200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:00.433160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:00.434043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:00.434043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:00.434043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:00.434043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:00.434043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 513/1032] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:00.440374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:00.528623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:00.550252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff46165-f4c8-4fc4-a3de-0f92f3b19707 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:00.586715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf146d-2743-4a24-8712-b7d238be906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:00.587345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf146d-2743-4a24-8712-b7d238be906d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.587659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf146d-2743-4a24-8712-b7d238be906d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.587938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf146d-2743-4a24-8712-b7d238be906d None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.588657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf146d-2743-4a24-8712-b7d238be906d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:00.588969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf146d-2743-4a24-8712-b7d238be906d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:00.590393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf146d-2743-4a24-8712-b7d238be906d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:00.607180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 520/1033] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:00.608854 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:00.629170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53cfd9-ebc5-49d7-9d2b-36c24622d4d9 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.629645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53cfd9-ebc5-49d7-9d2b-36c24622d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.629934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53cfd9-ebc5-49d7-9d2b-36c24622d4d9 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.632386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 521/1034] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:25:00.637489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487022c-9c65-44b4-8352-041b30e4b444 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.637784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487022c-9c65-44b4-8352-041b30e4b444 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.638066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487022c-9c65-44b4-8352-041b30e4b444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.656949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1487022c-9c65-44b4-8352-041b30e4b444 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:00.658148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1487022c-9c65-44b4-8352-041b30e4b444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:00.724099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:00.737240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8705718-5b4b-4d99-b13d-6d81e166d2f7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:00.743420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 522/1035] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:00.765987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487022c-9c65-44b4-8352-041b30e4b444 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:00.777984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:00.778742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.779022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.779294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.787770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:00.789327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:00.802120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:00.807955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:00.808940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 514/1036] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:25:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:00.810913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:00.847057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:00.879010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487022c-9c65-44b4-8352-041b30e4b444 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:00.913527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434b8ab-ea05-4ee7-8eef-8eb5473d99ca None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:00.914889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bc810-03a7-4359-adac-b86a2974b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:00.915819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc810-03a7-4359-adac-b86a2974b983 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.916103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc810-03a7-4359-adac-b86a2974b983 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.916375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc810-03a7-4359-adac-b86a2974b983 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.917521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bc810-03a7-4359-adac-b86a2974b983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:00.918957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bc810-03a7-4359-adac-b86a2974b983 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:00.920585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 523/1037] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:00.920585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4e25-c9cb-46d5-9da8-8613f14cc679 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.922122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4e25-c9cb-46d5-9da8-8613f14cc679 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.922403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4e25-c9cb-46d5-9da8-8613f14cc679 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.923757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 524/1038] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:00.926921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4e25-c9cb-46d5-9da8-8613f14cc679 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:00.950385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d6fe2-0514-4dc7-8168-ebec86f744de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:00.951006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6fe2-0514-4dc7-8168-ebec86f744de None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.951292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6fe2-0514-4dc7-8168-ebec86f744de None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.951594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6fe2-0514-4dc7-8168-ebec86f744de None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.952386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d6fe2-0514-4dc7-8168-ebec86f744de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:00.952694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d6fe2-0514-4dc7-8168-ebec86f744de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:00.954188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d6fe2-0514-4dc7-8168-ebec86f744de None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:00.971669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 515/1039] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:25:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:00.972950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7542-add7-4628-89d2-291f685bd1d7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:00.973246 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7542-add7-4628-89d2-291f685bd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:00.973524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7542-add7-4628-89d2-291f685bd1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:00.991636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4d0b7542-add7-4628-89d2-291f685bd1d7 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:00.992835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4d0b7542-add7-4628-89d2-291f685bd1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:00.996075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:01.035336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4e25-c9cb-46d5-9da8-8613f14cc679 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.067821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 516/1040] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:01.069653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b7542-add7-4628-89d2-291f685bd1d7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.077574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6abd-1c7f-4a0e-9fe5-93e7113d5edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.078265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6abd-1c7f-4a0e-9fe5-93e7113d5edc None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.078554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6abd-1c7f-4a0e-9fe5-93e7113d5edc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6abd-1c7f-4a0e-9fe5-93e7113d5edc None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.079537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc6abd-1c7f-4a0e-9fe5-93e7113d5edc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:01.080985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc6abd-1c7f-4a0e-9fe5-93e7113d5edc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:01.091612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:01.105420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 525/1041] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:25:00 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:25:01.106239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6abd-1c7f-4a0e-9fe5-93e7113d5edc None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.188757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b7542-add7-4628-89d2-291f685bd1d7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.228747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6abd-1c7f-4a0e-9fe5-93e7113d5edc None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.230286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cb91-87f8-47cc-8d8f-03a6fc2731dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.230927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cb91-87f8-47cc-8d8f-03a6fc2731dd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.231210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cb91-87f8-47cc-8d8f-03a6fc2731dd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.231516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cb91-87f8-47cc-8d8f-03a6fc2731dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.250918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:01.272473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.273409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.273693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.274132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] PATH_INFO: `/v3/services/image` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.275655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:01.276994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:01.287188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:01.288330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:01.289170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 526/1042] 10.222.0.71 () {56 vars in 1105 bytes} [Mon Aug 1 15:25:01 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:01.295283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.327232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cb91-87f8-47cc-8d8f-03a6fc2731dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:01.328866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cb91-87f8-47cc-8d8f-03a6fc2731dd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:01.372561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:01.422571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9902b6-5f70-40a4-9600-118ea256f32a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.443888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 517/1043] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:01.449334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cb91-87f8-47cc-8d8f-03a6fc2731dd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.465747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.466381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.466666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.466972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.467720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] RBAC: Adding query filter params (name=image) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:01.468030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:01.469424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:01.475820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 527/1044] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:01.481079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.500005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:01.562213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cb91-87f8-47cc-8d8f-03a6fc2731dd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.594921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492301b6-cb37-42c1-84fd-2a9967dc2acb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.599965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.600620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.600906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.601182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.611588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:01.613053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:01.621039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:01.629372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:01.630626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:01.631769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:01.631769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:01.631769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:01.631769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:01.635423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 518/1045] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:01.636294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.638368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.639009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.639293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.639601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.640868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] RBAC: Adding query filter params (type=image) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:01.640868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:01.641967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:01.647498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 528/1046] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:01.652878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.743823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:01.755761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05efd31-a9ff-42fb-8144-a89b2ce77e41 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.766029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae74e0-461a-4fd3-9b00-740331c9588f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.793589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.794557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.794993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.795281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.796142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:01.796455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:01.797842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:01.805336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334d80a-ec7d-432a-b374-373aa663f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.805966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d80a-ec7d-432a-b374-373aa663f72e None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.806252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d80a-ec7d-432a-b374-373aa663f72e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.806531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d80a-ec7d-432a-b374-373aa663f72e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.807288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334d80a-ec7d-432a-b374-373aa663f72e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:01.808694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334d80a-ec7d-432a-b374-373aa663f72e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:01.810685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 519/1047] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:01.816059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.843399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 529/1048] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:25:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:25:01.959521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa42eea-9ad6-4685-a6e8-02676c464d75 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:02.005041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:02.005379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.005641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.005918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.013437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:02.014908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:02.028409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:02.029317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:02.030414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 520/1049] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:02.035627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334d80a-ec7d-432a-b374-373aa663f72e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:02.086597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:02.150318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334d80a-ec7d-432a-b374-373aa663f72e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:02.186722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce4b0-0dd9-41c2-b29e-7b0f9927d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:02.187620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce4b0-0dd9-41c2-b29e-7b0f9927d333 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.188074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce4b0-0dd9-41c2-b29e-7b0f9927d333 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.188489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce4b0-0dd9-41c2-b29e-7b0f9927d333 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.189566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce4b0-0dd9-41c2-b29e-7b0f9927d333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:02.190034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce4b0-0dd9-41c2-b29e-7b0f9927d333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:02.191646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce4b0-0dd9-41c2-b29e-7b0f9927d333 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:02.204809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 530/1050] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:25:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:02.211871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:02.224712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:02.322490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153897a6-24aa-4d74-aaaa-27dc439ca571 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:02.357307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fe843-158f-44d8-8019-53a1c4788def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:02.358365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe843-158f-44d8-8019-53a1c4788def None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.358852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe843-158f-44d8-8019-53a1c4788def None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.359163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe843-158f-44d8-8019-53a1c4788def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.360342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fe843-158f-44d8-8019-53a1c4788def None admin] RBAC: Adding query filter params (role.id=da7c5226f6924e2dbe7f1124354110e5, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:02.360889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fe843-158f-44d8-8019-53a1c4788def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:02.363503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fe843-158f-44d8-8019-53a1c4788def None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:02.375466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 521/1051] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:02 2022] GET /identity/v3/role_assignments?user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=da7c5226f6924e2dbe7f1124354110e5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.218860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc0b81-1aa0-47fc-9aea-eb01de2e5841 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.219431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc0b81-1aa0-47fc-9aea-eb01de2e5841 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.219431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc0b81-1aa0-47fc-9aea-eb01de2e5841 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.220941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 531/1052] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:03.226949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52efda4-2ad2-423c-befe-cafaf316b840 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.227390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52efda4-2ad2-423c-befe-cafaf316b840 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.227563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52efda4-2ad2-423c-befe-cafaf316b840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.250432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e52efda4-2ad2-423c-befe-cafaf316b840 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:03.251819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e52efda4-2ad2-423c-befe-cafaf316b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:03.319324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 522/1053] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:03.342300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc0b81-1aa0-47fc-9aea-eb01de2e5841 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.449640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc0b81-1aa0-47fc-9aea-eb01de2e5841 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.451343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.489295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52106658-e6c1-4e7d-af1d-94a6a8afde1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.489891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52106658-e6c1-4e7d-af1d-94a6a8afde1c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.490176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52106658-e6c1-4e7d-af1d-94a6a8afde1c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.490452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52106658-e6c1-4e7d-af1d-94a6a8afde1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.502788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52106658-e6c1-4e7d-af1d-94a6a8afde1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-52106658-e6c1-4e7d-af1d-94a6a8afde1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:03.507648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:03.508585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:03.509498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:03.511691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 532/1054] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:03.514942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52efda4-2ad2-423c-befe-cafaf316b840 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.517180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.621868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52efda4-2ad2-423c-befe-cafaf316b840 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.656152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.656792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.657078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.657355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.658076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:03.658386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.659798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.669096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 523/1055] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.674925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52106658-e6c1-4e7d-af1d-94a6a8afde1c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.789793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52106658-e6c1-4e7d-af1d-94a6a8afde1c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.828003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5104b0-b3a4-4df5-b90a-1f50244ffd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.829099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5104b0-b3a4-4df5-b90a-1f50244ffd5d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.829763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5104b0-b3a4-4df5-b90a-1f50244ffd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.830106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5104b0-b3a4-4df5-b90a-1f50244ffd5d None admin] PATH_INFO: `/v3/users/dc559e1d02b1465c8bd124dafa2839fe` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.853814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5104b0-b3a4-4df5-b90a-1f50244ffd5d None admin] RBAC: Authorizing `identity:get_user(user_id=dc559e1d02b1465c8bd124dafa2839fe)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.856523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5104b0-b3a4-4df5-b90a-1f50244ffd5d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.864490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 533/1056] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/users/dc559e1d02b1465c8bd124dafa2839fe => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.865513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.913293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff637d-3d18-4304-afd7-95f390b8cd73 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.913601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff637d-3d18-4304-afd7-95f390b8cd73 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.913843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff637d-3d18-4304-afd7-95f390b8cd73 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.915684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 534/1057] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:25:03.920549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8404-efd2-459a-95ce-422ef254feed None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.920831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8404-efd2-459a-95ce-422ef254feed None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.921111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8404-efd2-459a-95ce-422ef254feed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.934144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.941525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2dee8404-efd2-459a-95ce-422ef254feed None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:03.942731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2dee8404-efd2-459a-95ce-422ef254feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:03.960532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.986683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d16c1-9ba9-490e-823a-ef80440d7491 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.027673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecb901-fcdd-4d2e-88a9-928514484262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.028294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb901-fcdd-4d2e-88a9-928514484262 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.028606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb901-fcdd-4d2e-88a9-928514484262 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.028841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb901-fcdd-4d2e-88a9-928514484262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.031219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 535/1058] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:04.056702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee8404-efd2-459a-95ce-422ef254feed None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.123266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecb901-fcdd-4d2e-88a9-928514484262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.124849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecb901-fcdd-4d2e-88a9-928514484262 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.194445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.196616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee8404-efd2-459a-95ce-422ef254feed None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.237985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075ad47-6fe3-4c6e-9299-6a95d75e3e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.238794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ad47-6fe3-4c6e-9299-6a95d75e3e72 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.238995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ad47-6fe3-4c6e-9299-6a95d75e3e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.239274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ad47-6fe3-4c6e-9299-6a95d75e3e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.240282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 524/1059] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:25:04.246015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecb901-fcdd-4d2e-88a9-928514484262 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.261496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.315210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075ad47-6fe3-4c6e-9299-6a95d75e3e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.316743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075ad47-6fe3-4c6e-9299-6a95d75e3e72 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.355021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecb901-fcdd-4d2e-88a9-928514484262 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.392467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13cd0-6a9d-4f5a-bf1e-b02712158de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.393119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13cd0-6a9d-4f5a-bf1e-b02712158de3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.393396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13cd0-6a9d-4f5a-bf1e-b02712158de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.393675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13cd0-6a9d-4f5a-bf1e-b02712158de3 None admin] PATH_INFO: `/v3/projects/744831536ae34ccca2c2d3f12fbfa823` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.394844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13cd0-6a9d-4f5a-bf1e-b02712158de3 None admin] RBAC: Authorizing `identity:get_project(project_id=744831536ae34ccca2c2d3f12fbfa823)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.396942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13cd0-6a9d-4f5a-bf1e-b02712158de3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.398673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 525/1060] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/projects/744831536ae34ccca2c2d3f12fbfa823 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:04.400814 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951354a0-6265-438e-b52c-efb5c0950574 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.401107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951354a0-6265-438e-b52c-efb5c0950574 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.401386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951354a0-6265-438e-b52c-efb5c0950574 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.406704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 526/1061] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:04.407555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951354a0-6265-438e-b52c-efb5c0950574 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.431422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 536/1062] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:25:04.431422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a784-8496-4045-a9db-389ae3d99d8c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.431422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a784-8496-4045-a9db-389ae3d99d8c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.431422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a784-8496-4045-a9db-389ae3d99d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.442300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.448897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9019a784-8496-4045-a9db-389ae3d99d8c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:04.450106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9019a784-8496-4045-a9db-389ae3d99d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:04.496956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.522465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951354a0-6265-438e-b52c-efb5c0950574 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.523647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 537/1063] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:04.524474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a784-8496-4045-a9db-389ae3d99d8c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.557133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.557750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.558029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.558304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.559080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=744831536ae34ccca2c2d3f12fbfa823, user.id=dc559e1d02b1465c8bd124dafa2839fe) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:04.559396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.560827 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.566528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 527/1064] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/role_assignments?user.id=dc559e1d02b1465c8bd124dafa2839fe&scope.project.id=744831536ae34ccca2c2d3f12fbfa823&role.id=7a7079c0864e4bb7acaa71238097426e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:04.567235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.645615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a784-8496-4045-a9db-389ae3d99d8c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.687413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.692820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.694033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.694311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.694584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.694682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96703d-3643-4812-b0c3-816260c600ea None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.706268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.708453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:04.726375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:04.727298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:04.728219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:04.728219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:04.728219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:04.728219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:04.728219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 538/1065] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:04.739476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.742428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3dca9-edda-4513-850d-8f8df8fdb05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.743081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3dca9-edda-4513-850d-8f8df8fdb05e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.743363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3dca9-edda-4513-850d-8f8df8fdb05e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.743677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3dca9-edda-4513-850d-8f8df8fdb05e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.755393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3dca9-edda-4513-850d-8f8df8fdb05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-15a3dca9-edda-4513-850d-8f8df8fdb05e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:04.761355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:04.762287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:04.763130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 528/1066] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:04.768736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3dca9-edda-4513-850d-8f8df8fdb05e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.789080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ea56-0e71-4ece-80e8-6461dfd58157 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.929525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3dca9-edda-4513-850d-8f8df8fdb05e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.951596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.952216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.952506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.952887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.954056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:04.954252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.955648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.983402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 539/1067] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:04.993119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.998360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.998360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.998360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.998360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:04.998360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.998360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.011867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 529/1068] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:05.019394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.145651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.158553 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a74df5-6bdc-4ef2-b814-3c521a7cd47e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.198198 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.198861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.199145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.199449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.211172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.212677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:05.229294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:05.230220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:05.231093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:05.231093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:05.231093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:05.231093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:05.231093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 540/1069] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:05.236598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.265203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.351558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee784c56-d0e7-4766-88ac-7259d40337e3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.385243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.385859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.386140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.386414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.387099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:05.387436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.388805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.402100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 530/1070] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:05.407825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.508576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55527729-c863-402a-86f8-bae7c02db6f5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.542187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.542830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.543114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.543408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.550795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.552847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:05.564171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:05.565133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:05.566068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 541/1071] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:05.571622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.649950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.673387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f0c7c-f439-4682-9a2a-ccd669741647 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.711998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.712689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.713076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.713416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.714316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:05.714618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.716057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.734575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 531/1072] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:05.740318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.744165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.841792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665781d-0dc0-454c-b8d3-fb71cac8ee3f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.875444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.876196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.876572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.876847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.887949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.889376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:05.904109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:05.905203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:05.906132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:05.906132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:05.906132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:05.906132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:05.906132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 542/1073] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:05.911168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.014675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39ba00-66ce-42da-90f6-0282a818761d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.053294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.053917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.054205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.054480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.055173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:06.055512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.056899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.059448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.069565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 532/1074] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.076037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.136076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.180874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9b77-1b0f-44c3-8b55-73eeafaa51aa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.214745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.215405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.215693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.215970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.222806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.224312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:06.235696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:06.236704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:06.237748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 543/1075] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:06.243226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.345879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f368146-f271-414b-ab8e-a9cb2283b2fe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.379211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5659a-d7e5-459e-9789-7d68226a0995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.379861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5659a-d7e5-459e-9789-7d68226a0995 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.380144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5659a-d7e5-459e-9789-7d68226a0995 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.381078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5659a-d7e5-459e-9789-7d68226a0995 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.381725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5659a-d7e5-459e-9789-7d68226a0995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:06.382036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5659a-d7e5-459e-9789-7d68226a0995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.383492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5659a-d7e5-459e-9789-7d68226a0995 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.396037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 533/1076] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.402317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.504866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1377e-82fb-4324-befb-f09fb79cee4c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.521775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.539741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b415b0-94ee-49e5-bb7b-06ccda6f0a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.540415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b415b0-94ee-49e5-bb7b-06ccda6f0a7f None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.540951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b415b0-94ee-49e5-bb7b-06ccda6f0a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.541229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b415b0-94ee-49e5-bb7b-06ccda6f0a7f None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/4aa7374d435f497d9e9bdd3c5d9d2c7c/roles/da7c5226f6924e2dbe7f1124354110e5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.543400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b415b0-94ee-49e5-bb7b-06ccda6f0a7f None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=4aa7374d435f497d9e9bdd3c5d9d2c7c, role_id=da7c5226f6924e2dbe7f1124354110e5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.544855 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b415b0-94ee-49e5-bb7b-06ccda6f0a7f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.559845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 544/1077] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:25:06 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/4aa7374d435f497d9e9bdd3c5d9d2c7c/roles/da7c5226f6924e2dbe7f1124354110e5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:06.609760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3461ab-b3a9-4059-a20c-d6782854049c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.610132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3461ab-b3a9-4059-a20c-d6782854049c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.610466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3461ab-b3a9-4059-a20c-d6782854049c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.611903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 534/1078] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:06.618586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec389a-8d1f-436b-9760-e3a0b7f2eae0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.618942 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec389a-8d1f-436b-9760-e3a0b7f2eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.619227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec389a-8d1f-436b-9760-e3a0b7f2eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.638457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-93ec389a-8d1f-436b-9760-e3a0b7f2eae0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:06.639747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93ec389a-8d1f-436b-9760-e3a0b7f2eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:06.717029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 545/1079] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:06.740748 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3461ab-b3a9-4059-a20c-d6782854049c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.802114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.851846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3461ab-b3a9-4059-a20c-d6782854049c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.886385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3ad41-b073-4732-94d7-11fb6d8d684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.887031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3ad41-b073-4732-94d7-11fb6d8d684f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.887313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3ad41-b073-4732-94d7-11fb6d8d684f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.887616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3ad41-b073-4732-94d7-11fb6d8d684f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.898031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3ad41-b073-4732-94d7-11fb6d8d684f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-28e3ad41-b073-4732-94d7-11fb6d8d684f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:06.902963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:06.904093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:06.910008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 535/1080] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:06.912884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec389a-8d1f-436b-9760-e3a0b7f2eae0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:07.018248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec389a-8d1f-436b-9760-e3a0b7f2eae0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:07.026725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:07.056569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:07.057189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.057468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.057795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.058510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:07.058813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:07.060214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:07.068336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 546/1081] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:07.074167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3ad41-b073-4732-94d7-11fb6d8d684f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:07.181560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3ad41-b073-4732-94d7-11fb6d8d684f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:07.198773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:07.217439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e17d9-bdf5-4e5b-ae67-846aaafd06e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:07.218092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e17d9-bdf5-4e5b-ae67-846aaafd06e4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.218385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e17d9-bdf5-4e5b-ae67-846aaafd06e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.218662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e17d9-bdf5-4e5b-ae67-846aaafd06e4 None admin] PATH_INFO: `/v3/users/dc559e1d02b1465c8bd124dafa2839fe` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.220120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e17d9-bdf5-4e5b-ae67-846aaafd06e4 None admin] RBAC: Authorizing `identity:get_user(user_id=dc559e1d02b1465c8bd124dafa2839fe)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:07.221566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e17d9-bdf5-4e5b-ae67-846aaafd06e4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:07.223199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 536/1082] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:07 2022] GET /identity/v3/users/dc559e1d02b1465c8bd124dafa2839fe => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:07.229613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:07.335770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7559626-80a0-4436-8ff3-835b2ea8627e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:07.372725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d4a32-7704-445b-b262-e23ddc9b78a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:07.373367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d4a32-7704-445b-b262-e23ddc9b78a0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.373648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d4a32-7704-445b-b262-e23ddc9b78a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.373925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d4a32-7704-445b-b262-e23ddc9b78a0 None admin] PATH_INFO: `/v3/projects/744831536ae34ccca2c2d3f12fbfa823` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.375126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d4a32-7704-445b-b262-e23ddc9b78a0 None admin] RBAC: Authorizing `identity:get_project(project_id=744831536ae34ccca2c2d3f12fbfa823)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:07.376543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d4a32-7704-445b-b262-e23ddc9b78a0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:07.378206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 547/1083] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:07 2022] GET /identity/v3/projects/744831536ae34ccca2c2d3f12fbfa823 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:07.384789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e17d9-bdf5-4e5b-ae67-846aaafd06e4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:07.486240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e17d9-bdf5-4e5b-ae67-846aaafd06e4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:07.520473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38eae9-71b5-46a7-9776-47479d040bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:07.521737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38eae9-71b5-46a7-9776-47479d040bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.522021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38eae9-71b5-46a7-9776-47479d040bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.522297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38eae9-71b5-46a7-9776-47479d040bb0 None admin] PATH_INFO: `/v3/projects/744831536ae34ccca2c2d3f12fbfa823/users/dc559e1d02b1465c8bd124dafa2839fe/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.524274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38eae9-71b5-46a7-9776-47479d040bb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=744831536ae34ccca2c2d3f12fbfa823, user_id=dc559e1d02b1465c8bd124dafa2839fe, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:07.525734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38eae9-71b5-46a7-9776-47479d040bb0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:07.541199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 537/1084] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:25:07 2022] PUT /identity/v3/projects/744831536ae34ccca2c2d3f12fbfa823/users/dc559e1d02b1465c8bd124dafa2839fe/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:08.568857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10ce3-5762-4814-a076-66168a47b537 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.569481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10ce3-5762-4814-a076-66168a47b537 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.569481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10ce3-5762-4814-a076-66168a47b537 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.570802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 548/1085] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:08.576956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586349-c61e-4a97-a2bc-a5723c61f36d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.577427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586349-c61e-4a97-a2bc-a5723c61f36d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.577946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586349-c61e-4a97-a2bc-a5723c61f36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.601548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d5586349-c61e-4a97-a2bc-a5723c61f36d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:08.602722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d5586349-c61e-4a97-a2bc-a5723c61f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:08.645191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:08.677823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 538/1086] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:08.701046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb10ce3-5762-4814-a076-66168a47b537 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:08.737958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:08.807404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb10ce3-5762-4814-a076-66168a47b537 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:08.850474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25a4e0-255d-41b3-bb1f-a7af9971cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:08.851042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a4e0-255d-41b3-bb1f-a7af9971cebd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.851318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a4e0-255d-41b3-bb1f-a7af9971cebd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.851623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a4e0-255d-41b3-bb1f-a7af9971cebd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.862547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25a4e0-255d-41b3-bb1f-a7af9971cebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-0e25a4e0-255d-41b3-bb1f-a7af9971cebd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:08.867527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:08.868629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:08.869519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 549/1087] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Aug 1 15:25:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:08.875261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586349-c61e-4a97-a2bc-a5723c61f36d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:08.984779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586349-c61e-4a97-a2bc-a5723c61f36d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.020699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.021906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.022195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.022479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.023203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:09.023550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.024940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.033761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 539/1088] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Aug 1 15:25:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:09.039616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25a4e0-255d-41b3-bb1f-a7af9971cebd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.142797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.150562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25a4e0-255d-41b3-bb1f-a7af9971cebd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.185857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.186506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.186791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.187066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.198669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.200226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:09.215686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:09.216837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:09.222761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:09.222761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:09.222761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:09.222761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:09.222761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 550/1089] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:09.223128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.263392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.329183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ae40b-40e2-4025-bb02-8185d0270902 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.362556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.363177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.363496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.363784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.364475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:09.365275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.366643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.378658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 540/1090] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:09.385054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.490299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12ea15-ba5e-4b12-a5f2-3adafa2d49f3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.526653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55538351-3d74-457e-99dc-24653ae9f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.527300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55538351-3d74-457e-99dc-24653ae9f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.527606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55538351-3d74-457e-99dc-24653ae9f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.527881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55538351-3d74-457e-99dc-24653ae9f9b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.536152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55538351-3d74-457e-99dc-24653ae9f9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.537684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55538351-3d74-457e-99dc-24653ae9f9b7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-55538351-3d74-457e-99dc-24653ae9f9b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:09.551580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:09.553150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:09.554140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 551/1091] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:09.559463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.571533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f806d3-3205-4700-864e-996202e6c329 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.572071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f806d3-3205-4700-864e-996202e6c329 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.572071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f806d3-3205-4700-864e-996202e6c329 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.573440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 552/1092] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:25:09.578372 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816d28-3af8-4fd1-8d68-bb615a38a9b7 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.578662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816d28-3af8-4fd1-8d68-bb615a38a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.578945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816d28-3af8-4fd1-8d68-bb615a38a9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.597216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a1816d28-3af8-4fd1-8d68-bb615a38a9b7 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:09.598433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a1816d28-3af8-4fd1-8d68-bb615a38a9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:09.601230 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.660393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.667123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156c3a-e863-4c8e-b52a-c7fb0a027973 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.670721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 553/1093] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:09.694245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816d28-3af8-4fd1-8d68-bb615a38a9b7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.703100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.703894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.704171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.704495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.705297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:09.705604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.707190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.726512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 541/1094] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:09.732155 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.807435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816d28-3af8-4fd1-8d68-bb615a38a9b7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.843461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2845e-6dac-4f81-b05c-fead3a0ef0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.844110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2845e-6dac-4f81-b05c-fead3a0ef0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.844387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2845e-6dac-4f81-b05c-fead3a0ef0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.844660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2845e-6dac-4f81-b05c-fead3a0ef0a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.845026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103fcf2-7517-4762-9c3a-6220518687a9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.852792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.856872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2845e-6dac-4f81-b05c-fead3a0ef0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-81a2845e-6dac-4f81-b05c-fead3a0ef0a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:09.862064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:09.863180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:09.864102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 554/1095] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:09.869383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2845e-6dac-4f81-b05c-fead3a0ef0a7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.883576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a135ebb-5e0d-467f-86ea-aebab70bd538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.884198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a135ebb-5e0d-467f-86ea-aebab70bd538 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.884485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a135ebb-5e0d-467f-86ea-aebab70bd538 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.884758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a135ebb-5e0d-467f-86ea-aebab70bd538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.909312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.956212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a135ebb-5e0d-467f-86ea-aebab70bd538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.957673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a135ebb-5e0d-467f-86ea-aebab70bd538 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.974439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2845e-6dac-4f81-b05c-fead3a0ef0a7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.010967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.011629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.011913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.012196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.012916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:10.013229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.014622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.023491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 555/1096] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:10.029331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.061107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 542/1097] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:25:10.066694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a135ebb-5e0d-467f-86ea-aebab70bd538 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.102260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.125794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.158332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702cdb3-63b4-4eb5-a9fa-a913c5dea22f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.178306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a135ebb-5e0d-467f-86ea-aebab70bd538 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.196139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef3c67-7ec2-4287-be4b-10403084c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.196794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef3c67-7ec2-4287-be4b-10403084c1bf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.197062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef3c67-7ec2-4287-be4b-10403084c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.197351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef3c67-7ec2-4287-be4b-10403084c1bf None admin] PATH_INFO: `/v3/users/dc559e1d02b1465c8bd124dafa2839fe` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.198485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef3c67-7ec2-4287-be4b-10403084c1bf None admin] RBAC: Authorizing `identity:get_user(user_id=dc559e1d02b1465c8bd124dafa2839fe)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.199976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef3c67-7ec2-4287-be4b-10403084c1bf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.201572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 556/1098] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/users/dc559e1d02b1465c8bd124dafa2839fe => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:10.207326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef3c67-7ec2-4287-be4b-10403084c1bf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.214920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.215591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.215872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.216144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.226588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.228066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:10.245219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:10.246165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:10.247217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:10.247217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:10.247217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:10.247217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:10.250216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 543/1099] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:10.251034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.326375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef3c67-7ec2-4287-be4b-10403084c1bf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.359567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.360213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d044-cdc7-4b15-b2ae-0ca93076ba3c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.368199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.371559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed6ff-15aa-4fb3-9e8f-1d098767c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.372190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed6ff-15aa-4fb3-9e8f-1d098767c1cb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.372603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed6ff-15aa-4fb3-9e8f-1d098767c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.372741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed6ff-15aa-4fb3-9e8f-1d098767c1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.396480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.397097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.397377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.397653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.398329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:10.398630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.400031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.412988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 544/1100] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:10.419928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.449637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed6ff-15aa-4fb3-9e8f-1d098767c1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.451090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed6ff-15aa-4fb3-9e8f-1d098767c1cb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.526736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5fd36-33ce-4883-95dd-315acaf863b7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.556701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 557/1101] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:25:10.561557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.562247 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.562532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.562691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed6ff-15aa-4fb3-9e8f-1d098767c1cb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.562788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.571565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.573013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:10.584523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:10.585401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:10.586287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 545/1102] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:10.591478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.591617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.624486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.671438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed6ff-15aa-4fb3-9e8f-1d098767c1cb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.705254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2504e3-48e1-497e-b917-25efcd6f48d5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.707643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c8535-2986-4094-b399-bf6d6f63a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.708803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c8535-2986-4094-b399-bf6d6f63a72d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.709101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c8535-2986-4094-b399-bf6d6f63a72d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.709380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c8535-2986-4094-b399-bf6d6f63a72d None admin] PATH_INFO: `/v3/projects/744831536ae34ccca2c2d3f12fbfa823` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.710578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c8535-2986-4094-b399-bf6d6f63a72d None admin] RBAC: Authorizing `identity:get_project(project_id=744831536ae34ccca2c2d3f12fbfa823)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.712085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c8535-2986-4094-b399-bf6d6f63a72d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.713752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 558/1103] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/projects/744831536ae34ccca2c2d3f12fbfa823 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:10.720149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c8535-2986-4094-b399-bf6d6f63a72d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.741814 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.742429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.742715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.742993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.743780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:10.744089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.745530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.757628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 546/1104] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:10.764572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.819013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.825287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c8535-2986-4094-b399-bf6d6f63a72d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.868258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.870433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15544-6e23-4eb0-b1a6-966370dbc879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.871061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15544-6e23-4eb0-b1a6-966370dbc879 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.871341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15544-6e23-4eb0-b1a6-966370dbc879 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.872093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15544-6e23-4eb0-b1a6-966370dbc879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.872886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb15544-6e23-4eb0-b1a6-966370dbc879 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=744831536ae34ccca2c2d3f12fbfa823, user.id=dc559e1d02b1465c8bd124dafa2839fe) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:10.873204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb15544-6e23-4eb0-b1a6-966370dbc879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.874652 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb15544-6e23-4eb0-b1a6-966370dbc879 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.880857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 559/1105] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/role_assignments?user.id=dc559e1d02b1465c8bd124dafa2839fe&scope.project.id=744831536ae34ccca2c2d3f12fbfa823&role.id=7a7079c0864e4bb7acaa71238097426e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:10.890181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c456e6-d1f1-4e3c-915d-6b13169de50c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.929793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26bc19-a8e3-4a5a-b9fe-03cecccc518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.930435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bc19-a8e3-4a5a-b9fe-03cecccc518b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.930721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bc19-a8e3-4a5a-b9fe-03cecccc518b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.930999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bc19-a8e3-4a5a-b9fe-03cecccc518b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.931862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26bc19-a8e3-4a5a-b9fe-03cecccc518b None admin] RBAC: Adding query filter params (role.id=da7c5226f6924e2dbe7f1124354110e5, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:10.932179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26bc19-a8e3-4a5a-b9fe-03cecccc518b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.933657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26bc19-a8e3-4a5a-b9fe-03cecccc518b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.941220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 547/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/role_assignments?user.id=4aa7374d435f497d9e9bdd3c5d9d2c7c&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=da7c5226f6924e2dbe7f1124354110e5 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:12.924025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5981-52ef-41bf-a2b7-3aef1796b732 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.924612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5981-52ef-41bf-a2b7-3aef1796b732 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.924612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5981-52ef-41bf-a2b7-3aef1796b732 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.925938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 560/1107] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:12.932334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bebbe1-8251-4cb7-ad71-30689d3924d8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.932771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bebbe1-8251-4cb7-ad71-30689d3924d8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.932884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bebbe1-8251-4cb7-ad71-30689d3924d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.951335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-68bebbe1-8251-4cb7-ad71-30689d3924d8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:12.952545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-68bebbe1-8251-4cb7-ad71-30689d3924d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:13.016984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 548/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:13.041132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd5981-52ef-41bf-a2b7-3aef1796b732 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.151083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd5981-52ef-41bf-a2b7-3aef1796b732 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.185436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bffb5-ceaa-4478-88ea-103f4bd86854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.186007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bffb5-ceaa-4478-88ea-103f4bd86854 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.186289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bffb5-ceaa-4478-88ea-103f4bd86854 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.186563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bffb5-ceaa-4478-88ea-103f4bd86854 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.187822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bffb5-ceaa-4478-88ea-103f4bd86854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:13.189258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bffb5-ceaa-4478-88ea-103f4bd86854 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:13.190847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 561/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:13.197315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bebbe1-8251-4cb7-ad71-30689d3924d8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.275656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.294935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bebbe1-8251-4cb7-ad71-30689d3924d8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.329660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58f905-77f8-49c2-950e-0834b5df0717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.330273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f905-77f8-49c2-950e-0834b5df0717 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.330561 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f905-77f8-49c2-950e-0834b5df0717 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.330824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f905-77f8-49c2-950e-0834b5df0717 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.331543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58f905-77f8-49c2-950e-0834b5df0717 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:13.332974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58f905-77f8-49c2-950e-0834b5df0717 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:13.355031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 549/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:25:13 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:15.416783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849208c8-3395-4e11-8060-63bac05e5a6f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:15.417337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849208c8-3395-4e11-8060-63bac05e5a6f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:15.417337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849208c8-3395-4e11-8060-63bac05e5a6f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:15.418698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 562/1111] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:15.424233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd2227-0af6-474f-a1b3-59b60ef74bcc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:15.424690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd2227-0af6-474f-a1b3-59b60ef74bcc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:15.424789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd2227-0af6-474f-a1b3-59b60ef74bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:15.444338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cadd2227-0af6-474f-a1b3-59b60ef74bcc None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:15.445537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cadd2227-0af6-474f-a1b3-59b60ef74bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:15.511753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 550/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:15.535283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849208c8-3395-4e11-8060-63bac05e5a6f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:15.564697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:15.642614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849208c8-3395-4e11-8060-63bac05e5a6f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:15.677224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354b41b-7e1e-43df-af3c-ea1e23b84547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:15.677862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b41b-7e1e-43df-af3c-ea1e23b84547 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:15.678159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b41b-7e1e-43df-af3c-ea1e23b84547 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:15.678410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b41b-7e1e-43df-af3c-ea1e23b84547 None admin] PATH_INFO: `/v3/roles/a3cb41ec3a524b60bc728cd4b0ab78e0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:15.679909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354b41b-7e1e-43df-af3c-ea1e23b84547 None admin] RBAC: Authorizing `identity:get_role(role_id=a3cb41ec3a524b60bc728cd4b0ab78e0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:15.681280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354b41b-7e1e-43df-af3c-ea1e23b84547 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:15.682629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 563/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:15 2022] GET /identity/v3/roles/a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:15.688892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd2227-0af6-474f-a1b3-59b60ef74bcc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:15.753559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:15.794847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd2227-0af6-474f-a1b3-59b60ef74bcc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:15.828400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c83d-b531-439d-879d-29bba2dd74f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:15.829039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c83d-b531-439d-879d-29bba2dd74f4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:15.829316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c83d-b531-439d-879d-29bba2dd74f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:15.829578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c83d-b531-439d-879d-29bba2dd74f4 None admin] PATH_INFO: `/v3/users/b946a18bc69c4ddd9d6039fb4e34ec71` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:15.843109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41c83d-b531-439d-879d-29bba2dd74f4 None admin] RBAC: Authorizing `identity:get_user(user_id=b946a18bc69c4ddd9d6039fb4e34ec71)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:15.844572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41c83d-b531-439d-879d-29bba2dd74f4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:15.846424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 551/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:15 2022] GET /identity/v3/users/b946a18bc69c4ddd9d6039fb4e34ec71 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:15.852432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354b41b-7e1e-43df-af3c-ea1e23b84547 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:15.951740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:15.958946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354b41b-7e1e-43df-af3c-ea1e23b84547 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:15.992549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5b286-b3f0-47a2-bab0-da3a7379f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:15.993168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5b286-b3f0-47a2-bab0-da3a7379f82e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:15.993448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5b286-b3f0-47a2-bab0-da3a7379f82e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:15.993722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5b286-b3f0-47a2-bab0-da3a7379f82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:16.070289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5b286-b3f0-47a2-bab0-da3a7379f82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:16.071685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5b286-b3f0-47a2-bab0-da3a7379f82e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:16.165957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:16.172638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 564/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:16.178610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c83d-b531-439d-879d-29bba2dd74f4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:16.293378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c83d-b531-439d-879d-29bba2dd74f4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:16.318754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:16.329920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe8835-0201-4377-b40a-f3aefce30558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:16.330495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe8835-0201-4377-b40a-f3aefce30558 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:16.330774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe8835-0201-4377-b40a-f3aefce30558 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:16.331047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe8835-0201-4377-b40a-f3aefce30558 None admin] PATH_INFO: `/v3/projects/744831536ae34ccca2c2d3f12fbfa823` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:16.332228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe8835-0201-4377-b40a-f3aefce30558 None admin] RBAC: Authorizing `identity:get_project(project_id=744831536ae34ccca2c2d3f12fbfa823)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:16.334305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe8835-0201-4377-b40a-f3aefce30558 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:16.336037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 552/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:16 2022] GET /identity/v3/projects/744831536ae34ccca2c2d3f12fbfa823 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:16.342293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5b286-b3f0-47a2-bab0-da3a7379f82e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:16.439919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5b286-b3f0-47a2-bab0-da3a7379f82e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:16.478304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d67000-3c87-4986-ba05-96a0e7b8c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:16.478922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67000-3c87-4986-ba05-96a0e7b8c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:16.479203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67000-3c87-4986-ba05-96a0e7b8c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:16.479506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67000-3c87-4986-ba05-96a0e7b8c2b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:16.480292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d67000-3c87-4986-ba05-96a0e7b8c2b1 None admin] RBAC: Adding query filter params (role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=744831536ae34ccca2c2d3f12fbfa823, user.id=b946a18bc69c4ddd9d6039fb4e34ec71) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:16.480597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d67000-3c87-4986-ba05-96a0e7b8c2b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:16.482027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d67000-3c87-4986-ba05-96a0e7b8c2b1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:16.487619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 565/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:16 2022] GET /identity/v3/role_assignments?user.id=b946a18bc69c4ddd9d6039fb4e34ec71&scope.project.id=744831536ae34ccca2c2d3f12fbfa823&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:18.508163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0b22-323c-469e-9b3e-1bba5fc2ade2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.508680 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0b22-323c-469e-9b3e-1bba5fc2ade2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.508680 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0b22-323c-469e-9b3e-1bba5fc2ade2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.509967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 553/1118] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:18.515089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d329bc0-facd-4f7f-aaa6-23c2fc14d6ce None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.515532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d329bc0-facd-4f7f-aaa6-23c2fc14d6ce None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.515778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d329bc0-facd-4f7f-aaa6-23c2fc14d6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.533487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4d329bc0-facd-4f7f-aaa6-23c2fc14d6ce None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:18.534669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4d329bc0-facd-4f7f-aaa6-23c2fc14d6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:18.591046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.603297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 566/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:18.628541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde0b22-323c-469e-9b3e-1bba5fc2ade2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.734590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde0b22-323c-469e-9b3e-1bba5fc2ade2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:18.768347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015582a-d0ab-496e-9299-3f5e3e6d8386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:18.769119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015582a-d0ab-496e-9299-3f5e3e6d8386 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.769435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015582a-d0ab-496e-9299-3f5e3e6d8386 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.769763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015582a-d0ab-496e-9299-3f5e3e6d8386 None admin] PATH_INFO: `/v3/roles/a3cb41ec3a524b60bc728cd4b0ab78e0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.771328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015582a-d0ab-496e-9299-3f5e3e6d8386 None admin] RBAC: Authorizing `identity:get_role(role_id=a3cb41ec3a524b60bc728cd4b0ab78e0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:18.772770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015582a-d0ab-496e-9299-3f5e3e6d8386 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:18.774207 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 554/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/roles/a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:18.782818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d329bc0-facd-4f7f-aaa6-23c2fc14d6ce None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.886242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d329bc0-facd-4f7f-aaa6-23c2fc14d6ce None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:18.920555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b67474-6953-47a6-b53b-3c5e520a9ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:18.921207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b67474-6953-47a6-b53b-3c5e520a9ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.921493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b67474-6953-47a6-b53b-3c5e520a9ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.921818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b67474-6953-47a6-b53b-3c5e520a9ad7 None admin] PATH_INFO: `/v3/users/b946a18bc69c4ddd9d6039fb4e34ec71` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.923073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b67474-6953-47a6-b53b-3c5e520a9ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=b946a18bc69c4ddd9d6039fb4e34ec71)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:18.924554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b67474-6953-47a6-b53b-3c5e520a9ad7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:18.926218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 567/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/users/b946a18bc69c4ddd9d6039fb4e34ec71 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:18.932807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015582a-d0ab-496e-9299-3f5e3e6d8386 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.992364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:19.039008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015582a-d0ab-496e-9299-3f5e3e6d8386 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:19.074046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901aa0c-3233-4a3e-bcaa-df2bdcf37284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:19.074696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901aa0c-3233-4a3e-bcaa-df2bdcf37284 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.074980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901aa0c-3233-4a3e-bcaa-df2bdcf37284 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.075265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901aa0c-3233-4a3e-bcaa-df2bdcf37284 None admin] PATH_INFO: `/v3/projects/744831536ae34ccca2c2d3f12fbfa823` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.076463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901aa0c-3233-4a3e-bcaa-df2bdcf37284 None admin] RBAC: Authorizing `identity:get_project(project_id=744831536ae34ccca2c2d3f12fbfa823)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:19.077935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901aa0c-3233-4a3e-bcaa-df2bdcf37284 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:19.079723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 555/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/projects/744831536ae34ccca2c2d3f12fbfa823 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:19.086257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b67474-6953-47a6-b53b-3c5e520a9ad7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:19.146366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:19.189406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b67474-6953-47a6-b53b-3c5e520a9ad7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:19.223307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe0105-1545-4959-89d9-8fd5b033feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:19.224572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe0105-1545-4959-89d9-8fd5b033feeb None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.224856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe0105-1545-4959-89d9-8fd5b033feeb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.225133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe0105-1545-4959-89d9-8fd5b033feeb None admin] PATH_INFO: `/v3/projects/744831536ae34ccca2c2d3f12fbfa823/users/b946a18bc69c4ddd9d6039fb4e34ec71/roles/a3cb41ec3a524b60bc728cd4b0ab78e0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.227322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe0105-1545-4959-89d9-8fd5b033feeb None admin] RBAC: Authorizing `identity:create_grant(project_id=744831536ae34ccca2c2d3f12fbfa823, user_id=b946a18bc69c4ddd9d6039fb4e34ec71, role_id=a3cb41ec3a524b60bc728cd4b0ab78e0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:19.228801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe0105-1545-4959-89d9-8fd5b033feeb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:19.242621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 568/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:25:19 2022] PUT /identity/v3/projects/744831536ae34ccca2c2d3f12fbfa823/users/b946a18bc69c4ddd9d6039fb4e34ec71/roles/a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:21.252290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8bcb-080f-4a2b-96aa-e19f74cb6a4b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.253044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8bcb-080f-4a2b-96aa-e19f74cb6a4b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.253044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8bcb-080f-4a2b-96aa-e19f74cb6a4b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.254234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 556/1124] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:21.260590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79874af-c9f9-407f-893d-c27a16dee296 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.261055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79874af-c9f9-407f-893d-c27a16dee296 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.261149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79874af-c9f9-407f-893d-c27a16dee296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.279728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e79874af-c9f9-407f-893d-c27a16dee296 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:21.280951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e79874af-c9f9-407f-893d-c27a16dee296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:21.352551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 569/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:21.376036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e8bcb-080f-4a2b-96aa-e19f74cb6a4b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:21.487639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e8bcb-080f-4a2b-96aa-e19f74cb6a4b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:21.518360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:21.526730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca39a7-9190-405d-bc7e-fa9114baea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:21.527388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca39a7-9190-405d-bc7e-fa9114baea5d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.527676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca39a7-9190-405d-bc7e-fa9114baea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.527954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca39a7-9190-405d-bc7e-fa9114baea5d None admin] PATH_INFO: `/v3/roles/a3cb41ec3a524b60bc728cd4b0ab78e0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.529390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca39a7-9190-405d-bc7e-fa9114baea5d None admin] RBAC: Authorizing `identity:get_role(role_id=a3cb41ec3a524b60bc728cd4b0ab78e0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:21.530762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca39a7-9190-405d-bc7e-fa9114baea5d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:21.532188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 557/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:21 2022] GET /identity/v3/roles/a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:21.538094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79874af-c9f9-407f-893d-c27a16dee296 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:21.586512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:21.641804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79874af-c9f9-407f-893d-c27a16dee296 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:21.680185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3338cf-36ef-4e52-aa13-51392d383cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:21.680826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3338cf-36ef-4e52-aa13-51392d383cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.681107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3338cf-36ef-4e52-aa13-51392d383cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.681384 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3338cf-36ef-4e52-aa13-51392d383cb5 None admin] PATH_INFO: `/v3/users/b946a18bc69c4ddd9d6039fb4e34ec71` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.682616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3338cf-36ef-4e52-aa13-51392d383cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=b946a18bc69c4ddd9d6039fb4e34ec71)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:21.684147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3338cf-36ef-4e52-aa13-51392d383cb5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:21.685831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 570/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:21 2022] GET /identity/v3/users/b946a18bc69c4ddd9d6039fb4e34ec71 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:21.696389 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca39a7-9190-405d-bc7e-fa9114baea5d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:21.811445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca39a7-9190-405d-bc7e-fa9114baea5d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:21.850575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64f04-35b4-4fac-a96d-0c0c28b015a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:21.851220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64f04-35b4-4fac-a96d-0c0c28b015a6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.851586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64f04-35b4-4fac-a96d-0c0c28b015a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.851860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64f04-35b4-4fac-a96d-0c0c28b015a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.916243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:21.923725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e64f04-35b4-4fac-a96d-0c0c28b015a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:21.925216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e64f04-35b4-4fac-a96d-0c0c28b015a6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.025379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 558/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:22.031398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3338cf-36ef-4e52-aa13-51392d383cb5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.138875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3338cf-36ef-4e52-aa13-51392d383cb5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.157789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.177826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07ad4-ebaf-4b0f-973c-45c74df1c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.178470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07ad4-ebaf-4b0f-973c-45c74df1c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.178752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07ad4-ebaf-4b0f-973c-45c74df1c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.179030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07ad4-ebaf-4b0f-973c-45c74df1c5c8 None admin] PATH_INFO: `/v3/projects/744831536ae34ccca2c2d3f12fbfa823` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.180276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e07ad4-ebaf-4b0f-973c-45c74df1c5c8 None admin] RBAC: Authorizing `identity:get_project(project_id=744831536ae34ccca2c2d3f12fbfa823)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.181751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e07ad4-ebaf-4b0f-973c-45c74df1c5c8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.183497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 571/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/projects/744831536ae34ccca2c2d3f12fbfa823 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:22.189734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64f04-35b4-4fac-a96d-0c0c28b015a6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.287539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.294940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64f04-35b4-4fac-a96d-0c0c28b015a6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.332933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b877b3-972e-42b6-8611-13e4e3d9c950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.334092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b877b3-972e-42b6-8611-13e4e3d9c950 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.334370 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b877b3-972e-42b6-8611-13e4e3d9c950 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.334639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b877b3-972e-42b6-8611-13e4e3d9c950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.335613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b877b3-972e-42b6-8611-13e4e3d9c950 None admin] RBAC: Adding query filter params (role.id=a3cb41ec3a524b60bc728cd4b0ab78e0, scope.project.id=744831536ae34ccca2c2d3f12fbfa823, user.id=b946a18bc69c4ddd9d6039fb4e34ec71) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:22.335922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b877b3-972e-42b6-8611-13e4e3d9c950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.337348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b877b3-972e-42b6-8611-13e4e3d9c950 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.343364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 559/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/role_assignments?user.id=b946a18bc69c4ddd9d6039fb4e34ec71&scope.project.id=744831536ae34ccca2c2d3f12fbfa823&role.id=a3cb41ec3a524b60bc728cd4b0ab78e0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:24.393768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937b483-a50c-4eac-a294-9cf3e1685028 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.394331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937b483-a50c-4eac-a294-9cf3e1685028 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.394331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937b483-a50c-4eac-a294-9cf3e1685028 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.396334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 572/1131] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:24.401717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce85e-93f3-42ac-9e19-48d336910bbf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.402158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce85e-93f3-42ac-9e19-48d336910bbf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.402263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce85e-93f3-42ac-9e19-48d336910bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.421181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5b0ce85e-93f3-42ac-9e19-48d336910bbf None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:24.422386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5b0ce85e-93f3-42ac-9e19-48d336910bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:24.493153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 560/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:24.516136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937b483-a50c-4eac-a294-9cf3e1685028 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.620799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937b483-a50c-4eac-a294-9cf3e1685028 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.659022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67990420-f961-48d2-b3f7-6a5f9d1a9d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.659701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990420-f961-48d2-b3f7-6a5f9d1a9d8c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.659993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990420-f961-48d2-b3f7-6a5f9d1a9d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.660266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990420-f961-48d2-b3f7-6a5f9d1a9d8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.661457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67990420-f961-48d2-b3f7-6a5f9d1a9d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.662978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67990420-f961-48d2-b3f7-6a5f9d1a9d8c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.664645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 573/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:24.670923 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce85e-93f3-42ac-9e19-48d336910bbf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.775060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.784860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce85e-93f3-42ac-9e19-48d336910bbf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.822698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8fc6-f57e-4d81-a156-4054fd887178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.823323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8fc6-f57e-4d81-a156-4054fd887178 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.823636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8fc6-f57e-4d81-a156-4054fd887178 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.823913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8fc6-f57e-4d81-a156-4054fd887178 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.824611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8fc6-f57e-4d81-a156-4054fd887178 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.826044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8fc6-f57e-4d81-a156-4054fd887178 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.857838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 561/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:25:24 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:27.022870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20350c-0039-41a0-beb1-6afee82bdb62 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.023460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20350c-0039-41a0-beb1-6afee82bdb62 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.023578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20350c-0039-41a0-beb1-6afee82bdb62 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.025004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 574/1135] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:27.030142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6f2d-1e18-4548-87c9-9a6a476d266d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.030515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6f2d-1e18-4548-87c9-9a6a476d266d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.030702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6f2d-1e18-4548-87c9-9a6a476d266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.049263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-052c6f2d-1e18-4548-87c9-9a6a476d266d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:27.050462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-052c6f2d-1e18-4548-87c9-9a6a476d266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:27.117088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 562/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:27.141293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20350c-0039-41a0-beb1-6afee82bdb62 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:27.199484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:27.251246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20350c-0039-41a0-beb1-6afee82bdb62 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:27.287522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca619c-c2d2-40b0-b210-e9b2bccadf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:27.288090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca619c-c2d2-40b0-b210-e9b2bccadf79 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.288373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca619c-c2d2-40b0-b210-e9b2bccadf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.288650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca619c-c2d2-40b0-b210-e9b2bccadf79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.289856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca619c-c2d2-40b0-b210-e9b2bccadf79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:27.291581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca619c-c2d2-40b0-b210-e9b2bccadf79 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:27.293195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 575/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:27.299086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c6f2d-1e18-4548-87c9-9a6a476d266d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:27.371687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:27.402685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c6f2d-1e18-4548-87c9-9a6a476d266d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:27.437980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e23c7-a669-4d28-9297-604901524f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:27.438617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e23c7-a669-4d28-9297-604901524f2d None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.438901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e23c7-a669-4d28-9297-604901524f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.439179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e23c7-a669-4d28-9297-604901524f2d None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.440023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e23c7-a669-4d28-9297-604901524f2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:27.441371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e23c7-a669-4d28-9297-604901524f2d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:27.467596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 563/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:25:27 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:25:29.518941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f96099-28b3-4899-944f-eddbb14dd301 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.519498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f96099-28b3-4899-944f-eddbb14dd301 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.519498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f96099-28b3-4899-944f-eddbb14dd301 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.521509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 576/1139] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:29.526901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9bac6-14ce-41e3-b213-0e419ff26d57 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.527344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9bac6-14ce-41e3-b213-0e419ff26d57 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.527465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9bac6-14ce-41e3-b213-0e419ff26d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.546371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-43b9bac6-14ce-41e3-b213-0e419ff26d57 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:29.547594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-43b9bac6-14ce-41e3-b213-0e419ff26d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:29.625114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 564/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:29.648531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f96099-28b3-4899-944f-eddbb14dd301 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.751594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f96099-28b3-4899-944f-eddbb14dd301 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.772641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.788862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a64bc-4eb3-40fe-9d6a-7770d2b808e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.789520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a64bc-4eb3-40fe-9d6a-7770d2b808e9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.789801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a64bc-4eb3-40fe-9d6a-7770d2b808e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.790078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a64bc-4eb3-40fe-9d6a-7770d2b808e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.800868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a64bc-4eb3-40fe-9d6a-7770d2b808e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-595a64bc-4eb3-40fe-9d6a-7770d2b808e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:29.805839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:29.807010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:29.808139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 577/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:29.813328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9bac6-14ce-41e3-b213-0e419ff26d57 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.871085 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.913905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9bac6-14ce-41e3-b213-0e419ff26d57 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.947701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.948319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.948604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.948880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.949595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:29.949902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:29.951271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:29.959475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 565/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:29.965890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a64bc-4eb3-40fe-9d6a-7770d2b808e9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.070102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a64bc-4eb3-40fe-9d6a-7770d2b808e9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.112618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef0516-71f1-4776-8143-970d71aa0be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.113299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef0516-71f1-4776-8143-970d71aa0be8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.113643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef0516-71f1-4776-8143-970d71aa0be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.113953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef0516-71f1-4776-8143-970d71aa0be8 None admin] PATH_INFO: `/v3/users/4a75cd5a23854f8ba5cd931530bcbab5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.128705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef0516-71f1-4776-8143-970d71aa0be8 None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cd5a23854f8ba5cd931530bcbab5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.130681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef0516-71f1-4776-8143-970d71aa0be8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.132693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 578/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/users/4a75cd5a23854f8ba5cd931530bcbab5 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:30.138457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.238422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2faa76-3d4e-4157-9340-56750fb3ddc4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.260706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.274805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da2ed0-e6a1-4519-a32a-608978fb0f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.275461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da2ed0-e6a1-4519-a32a-608978fb0f9d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.275749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da2ed0-e6a1-4519-a32a-608978fb0f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.276027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da2ed0-e6a1-4519-a32a-608978fb0f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.343456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da2ed0-e6a1-4519-a32a-608978fb0f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.344836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da2ed0-e6a1-4519-a32a-608978fb0f9d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.447562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 566/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:30.453533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef0516-71f1-4776-8143-970d71aa0be8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.493505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.553304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef0516-71f1-4776-8143-970d71aa0be8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.590036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220ea2d-facb-4931-bd56-716f5700f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.590676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220ea2d-facb-4931-bd56-716f5700f21f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.590956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220ea2d-facb-4931-bd56-716f5700f21f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.591232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220ea2d-facb-4931-bd56-716f5700f21f None admin] PATH_INFO: `/v3/projects/7fdc6395b34f4823ad899566d5ab4e03` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.592435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220ea2d-facb-4931-bd56-716f5700f21f None admin] RBAC: Authorizing `identity:get_project(project_id=7fdc6395b34f4823ad899566d5ab4e03)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.593940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220ea2d-facb-4931-bd56-716f5700f21f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.595595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 579/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/projects/7fdc6395b34f4823ad899566d5ab4e03 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:30.602448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da2ed0-e6a1-4519-a32a-608978fb0f9d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.623895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.701960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da2ed0-e6a1-4519-a32a-608978fb0f9d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.735563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d000eb4-3f3c-4eb0-aa25-71f0fee7c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.736178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d000eb4-3f3c-4eb0-aa25-71f0fee7c28f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.736462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d000eb4-3f3c-4eb0-aa25-71f0fee7c28f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.736738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d000eb4-3f3c-4eb0-aa25-71f0fee7c28f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.737524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d000eb4-3f3c-4eb0-aa25-71f0fee7c28f None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=7fdc6395b34f4823ad899566d5ab4e03, user.id=4a75cd5a23854f8ba5cd931530bcbab5) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:30.737837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d000eb4-3f3c-4eb0-aa25-71f0fee7c28f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.739319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d000eb4-3f3c-4eb0-aa25-71f0fee7c28f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.745429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 567/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/role_assignments?user.id=4a75cd5a23854f8ba5cd931530bcbab5&scope.project.id=7fdc6395b34f4823ad899566d5ab4e03&role.id=7a7079c0864e4bb7acaa71238097426e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:32.776539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab339e0-4161-4a24-a131-976a7cc99d3e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.777075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab339e0-4161-4a24-a131-976a7cc99d3e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.777375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab339e0-4161-4a24-a131-976a7cc99d3e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.779360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 580/1147] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:32.785185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047283-221f-4818-acbe-e1fe8e945b6d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.785662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047283-221f-4818-acbe-e1fe8e945b6d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.785761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047283-221f-4818-acbe-e1fe8e945b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.804335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f2047283-221f-4818-acbe-e1fe8e945b6d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:32.805527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f2047283-221f-4818-acbe-e1fe8e945b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:32.878056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 568/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:32.903431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab339e0-4161-4a24-a131-976a7cc99d3e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.021669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab339e0-4161-4a24-a131-976a7cc99d3e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.029691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.058850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc4e8-4a8e-477b-ab1c-4a833ffd43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.059527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc4e8-4a8e-477b-ab1c-4a833ffd43ee None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.059930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc4e8-4a8e-477b-ab1c-4a833ffd43ee None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.060488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc4e8-4a8e-477b-ab1c-4a833ffd43ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.072667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bc4e8-4a8e-477b-ab1c-4a833ffd43ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-bf2bc4e8-4a8e-477b-ab1c-4a833ffd43ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:33.077674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:33.078838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:33.080069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 581/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:33.087333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047283-221f-4818-acbe-e1fe8e945b6d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.103491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.199967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047283-221f-4818-acbe-e1fe8e945b6d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.233852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.234637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.234925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.235204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.235953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:33.236256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.237635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.247061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 569/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:33.253190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc4e8-4a8e-477b-ab1c-4a833ffd43ee None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.356126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc4e8-4a8e-477b-ab1c-4a833ffd43ee None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.391212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e11a37-19b9-4044-812c-a7782c0e4ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.391889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11a37-19b9-4044-812c-a7782c0e4ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.392173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11a37-19b9-4044-812c-a7782c0e4ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.392447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11a37-19b9-4044-812c-a7782c0e4ce3 None admin] PATH_INFO: `/v3/users/4a75cd5a23854f8ba5cd931530bcbab5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.393618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e11a37-19b9-4044-812c-a7782c0e4ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cd5a23854f8ba5cd931530bcbab5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.395054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e11a37-19b9-4044-812c-a7782c0e4ce3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.396715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 582/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:33 2022] GET /identity/v3/users/4a75cd5a23854f8ba5cd931530bcbab5 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:33.402721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.481612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.505671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22489fbc-37c5-4f52-b3d8-69649a2f6438 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.543764 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee69f9c-5a72-4043-8fbb-89d67ffc9cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.544419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee69f9c-5a72-4043-8fbb-89d67ffc9cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.544717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee69f9c-5a72-4043-8fbb-89d67ffc9cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.544991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee69f9c-5a72-4043-8fbb-89d67ffc9cc6 None admin] PATH_INFO: `/v3/projects/7fdc6395b34f4823ad899566d5ab4e03` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.546168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee69f9c-5a72-4043-8fbb-89d67ffc9cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=7fdc6395b34f4823ad899566d5ab4e03)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.547709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee69f9c-5a72-4043-8fbb-89d67ffc9cc6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.549391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 570/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:33 2022] GET /identity/v3/projects/7fdc6395b34f4823ad899566d5ab4e03 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:33.556620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e11a37-19b9-4044-812c-a7782c0e4ce3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.591704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.658531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e11a37-19b9-4044-812c-a7782c0e4ce3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.693450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed4f2e-3190-491d-b53d-2f9a40833dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.694100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4f2e-3190-491d-b53d-2f9a40833dc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.694380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4f2e-3190-491d-b53d-2f9a40833dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.694655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4f2e-3190-491d-b53d-2f9a40833dc4 None admin] PATH_INFO: `/v3/projects/7fdc6395b34f4823ad899566d5ab4e03/users/4a75cd5a23854f8ba5cd931530bcbab5/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.696584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed4f2e-3190-491d-b53d-2f9a40833dc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fdc6395b34f4823ad899566d5ab4e03, user_id=4a75cd5a23854f8ba5cd931530bcbab5, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.698018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed4f2e-3190-491d-b53d-2f9a40833dc4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.712345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 583/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:25:33 2022] PUT /identity/v3/projects/7fdc6395b34f4823ad899566d5ab4e03/users/4a75cd5a23854f8ba5cd931530bcbab5/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:35.788358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d537-fa98-4e85-8704-a8790ad5eae5 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.788911 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d537-fa98-4e85-8704-a8790ad5eae5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.788911 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d537-fa98-4e85-8704-a8790ad5eae5 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.790316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 571/1154] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:35.795913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eea50-995c-4290-9e6b-05c711915604 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.796314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eea50-995c-4290-9e6b-05c711915604 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.796473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eea50-995c-4290-9e6b-05c711915604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.814503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f69eea50-995c-4290-9e6b-05c711915604 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:35.815739 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f69eea50-995c-4290-9e6b-05c711915604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:35.884533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 584/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:35.908707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d537-fa98-4e85-8704-a8790ad5eae5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.010095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d537-fa98-4e85-8704-a8790ad5eae5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.044701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1e92-c2c8-40c1-9a22-f5b4ef18446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.045264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1e92-c2c8-40c1-9a22-f5b4ef18446e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.045548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1e92-c2c8-40c1-9a22-f5b4ef18446e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.045823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1e92-c2c8-40c1-9a22-f5b4ef18446e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.056125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1e92-c2c8-40c1-9a22-f5b4ef18446e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ca5f1e92-c2c8-40c1-9a22-f5b4ef18446e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:36.061048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:36.062139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:36.063266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 572/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:36.069416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eea50-995c-4290-9e6b-05c711915604 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.094417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.171472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eea50-995c-4290-9e6b-05c711915604 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.206376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.206999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.207284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.207588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.208341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:36.208645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.210025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.218213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 585/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:36.224228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1e92-c2c8-40c1-9a22-f5b4ef18446e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.228653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.329191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1e92-c2c8-40c1-9a22-f5b4ef18446e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.363573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581d2e-917b-473c-8d02-15b7a7aee094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.364733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581d2e-917b-473c-8d02-15b7a7aee094 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.365009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581d2e-917b-473c-8d02-15b7a7aee094 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.365275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581d2e-917b-473c-8d02-15b7a7aee094 None admin] PATH_INFO: `/v3/users/4a75cd5a23854f8ba5cd931530bcbab5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.366424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581d2e-917b-473c-8d02-15b7a7aee094 None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cd5a23854f8ba5cd931530bcbab5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.367889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581d2e-917b-473c-8d02-15b7a7aee094 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.369486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 573/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/users/4a75cd5a23854f8ba5cd931530bcbab5 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:36.375683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.475709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.491421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b147e9-d0bb-478c-8a40-81e5f15d28d2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.525383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbcc12-1290-484e-bf79-535e10741153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.526017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcc12-1290-484e-bf79-535e10741153 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.526303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcc12-1290-484e-bf79-535e10741153 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.526583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcc12-1290-484e-bf79-535e10741153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.597302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbcc12-1290-484e-bf79-535e10741153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.598249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbcc12-1290-484e-bf79-535e10741153 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.688896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.704480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 586/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:36.710834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581d2e-917b-473c-8d02-15b7a7aee094 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.780305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.810134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581d2e-917b-473c-8d02-15b7a7aee094 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.842590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbba724-9826-4b7c-bdb2-ecabb25ac55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.843223 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbba724-9826-4b7c-bdb2-ecabb25ac55b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.843526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbba724-9826-4b7c-bdb2-ecabb25ac55b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.843800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbba724-9826-4b7c-bdb2-ecabb25ac55b None admin] PATH_INFO: `/v3/projects/7fdc6395b34f4823ad899566d5ab4e03` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.844924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbba724-9826-4b7c-bdb2-ecabb25ac55b None admin] RBAC: Authorizing `identity:get_project(project_id=7fdc6395b34f4823ad899566d5ab4e03)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.846347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbba724-9826-4b7c-bdb2-ecabb25ac55b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.848104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 574/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/projects/7fdc6395b34f4823ad899566d5ab4e03 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:36.854959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbcc12-1290-484e-bf79-535e10741153 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.956769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbcc12-1290-484e-bf79-535e10741153 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.991653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf07df5-68a7-4841-876b-46a2a1bbf0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.992261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07df5-68a7-4841-876b-46a2a1bbf0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.992539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07df5-68a7-4841-876b-46a2a1bbf0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.992810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07df5-68a7-4841-876b-46a2a1bbf0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.993582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf07df5-68a7-4841-876b-46a2a1bbf0f7 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=7fdc6395b34f4823ad899566d5ab4e03, user.id=4a75cd5a23854f8ba5cd931530bcbab5) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:36.993893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf07df5-68a7-4841-876b-46a2a1bbf0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.995498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf07df5-68a7-4841-876b-46a2a1bbf0f7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.001117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 587/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/role_assignments?user.id=4a75cd5a23854f8ba5cd931530bcbab5&scope.project.id=7fdc6395b34f4823ad899566d5ab4e03&role.id=7a7079c0864e4bb7acaa71238097426e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:39.008082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc248c3-5b1c-445c-a70c-0d2b11e4e69e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.008640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc248c3-5b1c-445c-a70c-0d2b11e4e69e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.008640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc248c3-5b1c-445c-a70c-0d2b11e4e69e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.009970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 575/1162] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:39.015299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b04268-9e5f-4530-b20f-2d17ba2e22bd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.015738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b04268-9e5f-4530-b20f-2d17ba2e22bd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.015886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b04268-9e5f-4530-b20f-2d17ba2e22bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.033426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-03b04268-9e5f-4530-b20f-2d17ba2e22bd None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:39.034595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-03b04268-9e5f-4530-b20f-2d17ba2e22bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:39.081143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.102270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 588/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:39.124766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc248c3-5b1c-445c-a70c-0d2b11e4e69e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.224858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc248c3-5b1c-445c-a70c-0d2b11e4e69e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.257980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e2422-4786-4015-b7f2-56ab76b3cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.258656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2422-4786-4015-b7f2-56ab76b3cf75 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.258891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2422-4786-4015-b7f2-56ab76b3cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.259169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2422-4786-4015-b7f2-56ab76b3cf75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.269843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.326662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e2422-4786-4015-b7f2-56ab76b3cf75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.328257 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e2422-4786-4015-b7f2-56ab76b3cf75 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.423446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 576/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:39.429986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b04268-9e5f-4530-b20f-2d17ba2e22bd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.535702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b04268-9e5f-4530-b20f-2d17ba2e22bd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.571132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c63f-ce1d-4f97-a107-be47f33a7ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.571801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c63f-ce1d-4f97-a107-be47f33a7ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.572086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c63f-ce1d-4f97-a107-be47f33a7ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.572364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c63f-ce1d-4f97-a107-be47f33a7ad9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.578984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03c63f-ce1d-4f97-a107-be47f33a7ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.580450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03c63f-ce1d-4f97-a107-be47f33a7ad9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-fa03c63f-ce1d-4f97-a107-be47f33a7ad9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:39.592472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:39.593681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:39.594857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 589/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:39.599767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e2422-4786-4015-b7f2-56ab76b3cf75 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.639762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.696146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e2422-4786-4015-b7f2-56ab76b3cf75 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.728965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea6abf-bae6-4c18-aec0-d780677ffd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.729573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea6abf-bae6-4c18-aec0-d780677ffd2b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.729853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea6abf-bae6-4c18-aec0-d780677ffd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.730126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea6abf-bae6-4c18-aec0-d780677ffd2b None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.730806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea6abf-bae6-4c18-aec0-d780677ffd2b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:39.731106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea6abf-bae6-4c18-aec0-d780677ffd2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.732494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea6abf-bae6-4c18-aec0-d780677ffd2b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.739817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 577/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:41.712184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90e918-959a-41c2-9c85-21ea39730643 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.712762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90e918-959a-41c2-9c85-21ea39730643 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.712762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90e918-959a-41c2-9c85-21ea39730643 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.714110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 590/1167] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:41.719125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645385c-7450-4e0d-9338-08c326d9196c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.719569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645385c-7450-4e0d-9338-08c326d9196c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.719718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645385c-7450-4e0d-9338-08c326d9196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.737593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8645385c-7450-4e0d-9338-08c326d9196c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:41.738789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8645385c-7450-4e0d-9338-08c326d9196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:41.806042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 578/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:41.828899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90e918-959a-41c2-9c85-21ea39730643 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:41.871556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:41.929769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90e918-959a-41c2-9c85-21ea39730643 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:41.962334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50e8bb-2541-4c64-9753-99ba69cc8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:41.962888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e8bb-2541-4c64-9753-99ba69cc8d7a None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.963168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e8bb-2541-4c64-9753-99ba69cc8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.963469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e8bb-2541-4c64-9753-99ba69cc8d7a None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.964181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50e8bb-2541-4c64-9753-99ba69cc8d7a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:41.965543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50e8bb-2541-4c64-9753-99ba69cc8d7a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:41.982209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 591/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Mon Aug 1 15:25:41 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:43.996546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787a88b-c264-490d-93b8-4de15cf4378d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.997142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787a88b-c264-490d-93b8-4de15cf4378d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.997142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787a88b-c264-490d-93b8-4de15cf4378d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.998440 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 579/1170] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:44.003624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5e01d-1878-4554-95c2-5456bf668048 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.004033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5e01d-1878-4554-95c2-5456bf668048 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.004184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5e01d-1878-4554-95c2-5456bf668048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.022519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-39e5e01d-1878-4554-95c2-5456bf668048 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:44.023726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-39e5e01d-1878-4554-95c2-5456bf668048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:44.091752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 592/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:44.115713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787a88b-c264-490d-93b8-4de15cf4378d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.150718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.218154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787a88b-c264-490d-93b8-4de15cf4378d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.259116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640d6f3-9c1c-497c-a114-4beb72a38ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.259802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d6f3-9c1c-497c-a114-4beb72a38ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.260088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d6f3-9c1c-497c-a114-4beb72a38ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.260364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d6f3-9c1c-497c-a114-4beb72a38ff8 None admin] PATH_INFO: `/v3/domains/d0e2b62acc304c85b41edd376a9580f6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.271158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640d6f3-9c1c-497c-a114-4beb72a38ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d0e2b62acc304c85b41edd376a9580f6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.272666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640d6f3-9c1c-497c-a114-4beb72a38ff8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.274355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 580/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/domains/d0e2b62acc304c85b41edd376a9580f6 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:44.280357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5e01d-1878-4554-95c2-5456bf668048 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.312040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.384303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5e01d-1878-4554-95c2-5456bf668048 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.423396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96755cd-36bf-4789-b806-b24bb3b29db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.424018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96755cd-36bf-4789-b806-b24bb3b29db7 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.424297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96755cd-36bf-4789-b806-b24bb3b29db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.424569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96755cd-36bf-4789-b806-b24bb3b29db7 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.425437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96755cd-36bf-4789-b806-b24bb3b29db7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.427712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96755cd-36bf-4789-b806-b24bb3b29db7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.455892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 593/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:25:44 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:46.525302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049d73-c67b-42a2-a1c8-47554acad620 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.525833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049d73-c67b-42a2-a1c8-47554acad620 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.525833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049d73-c67b-42a2-a1c8-47554acad620 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.527209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 581/1174] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:46.533113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009542-35eb-463f-be17-3505b72ae879 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.533541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009542-35eb-463f-be17-3505b72ae879 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.533711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009542-35eb-463f-be17-3505b72ae879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.552189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-48009542-35eb-463f-be17-3505b72ae879 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:46.553534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-48009542-35eb-463f-be17-3505b72ae879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:46.620464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 594/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:46.645220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049d73-c67b-42a2-a1c8-47554acad620 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.750193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.759888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049d73-c67b-42a2-a1c8-47554acad620 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.799590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f8502-0514-418d-b071-5b2cc894782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.800160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8502-0514-418d-b071-5b2cc894782b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.800450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8502-0514-418d-b071-5b2cc894782b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.800717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8502-0514-418d-b071-5b2cc894782b None admin] PATH_INFO: `/v3/domains/d0e2b62acc304c85b41edd376a9580f6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.801978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f8502-0514-418d-b071-5b2cc894782b None admin] RBAC: Authorizing `identity:get_domain(domain_id=d0e2b62acc304c85b41edd376a9580f6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.803422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f8502-0514-418d-b071-5b2cc894782b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.805030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 582/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Mon Aug 1 15:25:46 2022] GET /identity/v3/domains/d0e2b62acc304c85b41edd376a9580f6 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:46.810836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009542-35eb-463f-be17-3505b72ae879 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.824987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.911544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009542-35eb-463f-be17-3505b72ae879 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.947793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb9048-8e90-48da-a117-57c158f15c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.948407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9048-8e90-48da-a117-57c158f15c5b None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.948687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9048-8e90-48da-a117-57c158f15c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.948960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9048-8e90-48da-a117-57c158f15c5b None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.949640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb9048-8e90-48da-a117-57c158f15c5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.951067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb9048-8e90-48da-a117-57c158f15c5b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.975429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 595/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:25:46 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:48.989600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c79165-1888-4214-ae10-e4274541bb7a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.990158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c79165-1888-4214-ae10-e4274541bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.990158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c79165-1888-4214-ae10-e4274541bb7a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.991508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 583/1178] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:48.997546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778cad-8ac0-4872-bded-0a878cde6fc6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.997960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778cad-8ac0-4872-bded-0a878cde6fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.998100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778cad-8ac0-4872-bded-0a878cde6fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.017447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d5778cad-8ac0-4872-bded-0a878cde6fc6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:49.018638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d5778cad-8ac0-4872-bded-0a878cde6fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:49.078797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.085408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 596/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:49.107938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c79165-1888-4214-ae10-e4274541bb7a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.208440 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c79165-1888-4214-ae10-e4274541bb7a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.241338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfc571-cc47-4d5f-a33c-04e1b8b481ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.241887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc571-cc47-4d5f-a33c-04e1b8b481ba None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.242169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc571-cc47-4d5f-a33c-04e1b8b481ba None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.242450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc571-cc47-4d5f-a33c-04e1b8b481ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.252522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfc571-cc47-4d5f-a33c-04e1b8b481ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e9dfc571-cc47-4d5f-a33c-04e1b8b481ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:49.258056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:49.259222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:49.260351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 584/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:49.265487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5778cad-8ac0-4872-bded-0a878cde6fc6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.361134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5778cad-8ac0-4872-bded-0a878cde6fc6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.394771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.395428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.395710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.395983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.396677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:49.396979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:49.398340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:49.406173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 597/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:49.412477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfc571-cc47-4d5f-a33c-04e1b8b481ba None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.437394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.511666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfc571-cc47-4d5f-a33c-04e1b8b481ba None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.544434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab741a-afeb-435d-a8d3-493b166ae666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.545063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab741a-afeb-435d-a8d3-493b166ae666 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.545343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab741a-afeb-435d-a8d3-493b166ae666 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.545615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab741a-afeb-435d-a8d3-493b166ae666 None admin] PATH_INFO: `/v3/users/2eb166e85c964317b00b42772f8836cb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.559281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab741a-afeb-435d-a8d3-493b166ae666 None admin] RBAC: Authorizing `identity:get_user(user_id=2eb166e85c964317b00b42772f8836cb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:49.560763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab741a-afeb-435d-a8d3-493b166ae666 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:49.562427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 585/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/users/2eb166e85c964317b00b42772f8836cb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:49.568254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.626525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.666335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700f8c6-9ac4-4757-a0dc-3d8b894ab53b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.698732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1a17-5f5f-44df-a4e2-23d87e7f066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.699348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1a17-5f5f-44df-a4e2-23d87e7f066e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.699641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1a17-5f5f-44df-a4e2-23d87e7f066e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.699902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1a17-5f5f-44df-a4e2-23d87e7f066e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.770844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1a17-5f5f-44df-a4e2-23d87e7f066e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:49.772258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1a17-5f5f-44df-a4e2-23d87e7f066e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:49.829920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.872147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 598/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:49.878325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab741a-afeb-435d-a8d3-493b166ae666 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.957266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.977507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab741a-afeb-435d-a8d3-493b166ae666 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.010345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763b6f5-b504-418d-81fe-b4b48f812b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.010981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763b6f5-b504-418d-81fe-b4b48f812b8c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.011264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763b6f5-b504-418d-81fe-b4b48f812b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.011564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763b6f5-b504-418d-81fe-b4b48f812b8c None admin] PATH_INFO: `/v3/projects/341cd41044f448d9adff7b12e5a62f4d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.012711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763b6f5-b504-418d-81fe-b4b48f812b8c None admin] RBAC: Authorizing `identity:get_project(project_id=341cd41044f448d9adff7b12e5a62f4d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.014134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763b6f5-b504-418d-81fe-b4b48f812b8c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.015822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 586/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/projects/341cd41044f448d9adff7b12e5a62f4d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:50.022572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1a17-5f5f-44df-a4e2-23d87e7f066e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.122165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1a17-5f5f-44df-a4e2-23d87e7f066e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.156910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda3960-ac44-494a-83ab-32b245cf56a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.157349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda3960-ac44-494a-83ab-32b245cf56a0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.157634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda3960-ac44-494a-83ab-32b245cf56a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.158028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda3960-ac44-494a-83ab-32b245cf56a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.158813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda3960-ac44-494a-83ab-32b245cf56a0 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=341cd41044f448d9adff7b12e5a62f4d, user.id=2eb166e85c964317b00b42772f8836cb) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:50.159123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda3960-ac44-494a-83ab-32b245cf56a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.160598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda3960-ac44-494a-83ab-32b245cf56a0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.166456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 599/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/role_assignments?user.id=2eb166e85c964317b00b42772f8836cb&scope.project.id=341cd41044f448d9adff7b12e5a62f4d&role.id=7a7079c0864e4bb7acaa71238097426e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:52.146777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb5cd-f452-4d3e-b536-a0178bf86f38 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.147339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb5cd-f452-4d3e-b536-a0178bf86f38 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.147339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb5cd-f452-4d3e-b536-a0178bf86f38 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.148813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 587/1186] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:52.153847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1caf1-421c-429f-b945-ab3377b46f51 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.154232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1caf1-421c-429f-b945-ab3377b46f51 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.154399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1caf1-421c-429f-b945-ab3377b46f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.175796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-11e1caf1-421c-429f-b945-ab3377b46f51 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:52.177022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-11e1caf1-421c-429f-b945-ab3377b46f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:52.194971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.244807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 600/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:52.266648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edb5cd-f452-4d3e-b536-a0178bf86f38 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.366135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edb5cd-f452-4d3e-b536-a0178bf86f38 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.399296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405ade6-c3fe-44fc-a25c-c30ed8b22c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.399900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405ade6-c3fe-44fc-a25c-c30ed8b22c73 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.400185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405ade6-c3fe-44fc-a25c-c30ed8b22c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.400463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405ade6-c3fe-44fc-a25c-c30ed8b22c73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.410713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405ade6-c3fe-44fc-a25c-c30ed8b22c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e405ade6-c3fe-44fc-a25c-c30ed8b22c73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:52.415686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:52.417054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:25:52.417901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 588/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:52.423383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1caf1-421c-429f-b945-ab3377b46f51 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.521642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1caf1-421c-429f-b945-ab3377b46f51 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.554933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.555570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.555851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.556123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.556821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:52.557123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.558494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.566413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 601/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:52.572956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405ade6-c3fe-44fc-a25c-c30ed8b22c73 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.586709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.682870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405ade6-c3fe-44fc-a25c-c30ed8b22c73 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.716483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3fe11-97ce-4e36-8566-314143b177a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.717122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3fe11-97ce-4e36-8566-314143b177a1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.717406 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3fe11-97ce-4e36-8566-314143b177a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.717683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3fe11-97ce-4e36-8566-314143b177a1 None admin] PATH_INFO: `/v3/users/2eb166e85c964317b00b42772f8836cb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.719008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3fe11-97ce-4e36-8566-314143b177a1 None admin] RBAC: Authorizing `identity:get_user(user_id=2eb166e85c964317b00b42772f8836cb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.720493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3fe11-97ce-4e36-8566-314143b177a1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.722126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 589/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/users/2eb166e85c964317b00b42772f8836cb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:52.728689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.747238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.827596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a880f13-a994-4208-b941-a9dec71bb5f6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.861600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5e8d5-9f8a-4000-ba9e-f363e004957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.862242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e8d5-9f8a-4000-ba9e-f363e004957d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.862526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e8d5-9f8a-4000-ba9e-f363e004957d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.862805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e8d5-9f8a-4000-ba9e-f363e004957d None admin] PATH_INFO: `/v3/projects/341cd41044f448d9adff7b12e5a62f4d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.863981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5e8d5-9f8a-4000-ba9e-f363e004957d None admin] RBAC: Authorizing `identity:get_project(project_id=341cd41044f448d9adff7b12e5a62f4d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.865428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5e8d5-9f8a-4000-ba9e-f363e004957d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.867096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 602/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/projects/341cd41044f448d9adff7b12e5a62f4d => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:52.873232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3fe11-97ce-4e36-8566-314143b177a1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.948072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.970686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3fe11-97ce-4e36-8566-314143b177a1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:53.003656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c2c75-e403-40ec-97c3-7b59b1ced10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:53.004324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2c75-e403-40ec-97c3-7b59b1ced10a None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.004605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2c75-e403-40ec-97c3-7b59b1ced10a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.004883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2c75-e403-40ec-97c3-7b59b1ced10a None admin] PATH_INFO: `/v3/projects/341cd41044f448d9adff7b12e5a62f4d/users/2eb166e85c964317b00b42772f8836cb/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.006956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c2c75-e403-40ec-97c3-7b59b1ced10a None admin] RBAC: Authorizing `identity:create_grant(project_id=341cd41044f448d9adff7b12e5a62f4d, user_id=2eb166e85c964317b00b42772f8836cb, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:53.008568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c2c75-e403-40ec-97c3-7b59b1ced10a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:53.021693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 590/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:25:52 2022] PUT /identity/v3/projects/341cd41044f448d9adff7b12e5a62f4d/users/2eb166e85c964317b00b42772f8836cb/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:54.981217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398e51-4197-4c93-96eb-5c555df05626 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.981738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398e51-4197-4c93-96eb-5c555df05626 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.981850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398e51-4197-4c93-96eb-5c555df05626 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.983125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 603/1193] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:25:54.988365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a66d61-e586-4e7c-b328-b29c22198f5c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.989298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a66d61-e586-4e7c-b328-b29c22198f5c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.989413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a66d61-e586-4e7c-b328-b29c22198f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.007463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-19a66d61-e586-4e7c-b328-b29c22198f5c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:55.008636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-19a66d61-e586-4e7c-b328-b29c22198f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:55.073277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 591/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:25:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:55.096252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59398e51-4197-4c93-96eb-5c555df05626 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.182167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.199715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59398e51-4197-4c93-96eb-5c555df05626 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.233844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d162dc5-c2e7-4321-8fde-e3468ba56b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.234416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d162dc5-c2e7-4321-8fde-e3468ba56b01 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.234701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d162dc5-c2e7-4321-8fde-e3468ba56b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.234980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d162dc5-c2e7-4321-8fde-e3468ba56b01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.245736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d162dc5-c2e7-4321-8fde-e3468ba56b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-0d162dc5-c2e7-4321-8fde-e3468ba56b01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:55.250703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:55.251822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:25:55.253044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 604/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:55.258475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a66d61-e586-4e7c-b328-b29c22198f5c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.321259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.355747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a66d61-e586-4e7c-b328-b29c22198f5c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.388722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.389331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.389608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.389903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.390581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:55.390881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.392332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.400090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 592/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:55.405897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d162dc5-c2e7-4321-8fde-e3468ba56b01 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.503259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d162dc5-c2e7-4321-8fde-e3468ba56b01 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.536171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8cd1-448f-46aa-9dec-8993cf915a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.536805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8cd1-448f-46aa-9dec-8993cf915a0c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.537083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8cd1-448f-46aa-9dec-8993cf915a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.537352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8cd1-448f-46aa-9dec-8993cf915a0c None admin] PATH_INFO: `/v3/users/2eb166e85c964317b00b42772f8836cb` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.538506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da8cd1-448f-46aa-9dec-8993cf915a0c None admin] RBAC: Authorizing `identity:get_user(user_id=2eb166e85c964317b00b42772f8836cb)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.539980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da8cd1-448f-46aa-9dec-8993cf915a0c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.541812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 605/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/users/2eb166e85c964317b00b42772f8836cb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:55.547720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.644637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f3b2-8222-46ef-89dc-fb68c1827a8b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.670176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.678538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f35057-2ba0-4780-b662-5d7249abb9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.679145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f35057-2ba0-4780-b662-5d7249abb9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.679459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f35057-2ba0-4780-b662-5d7249abb9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.679736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f35057-2ba0-4780-b662-5d7249abb9a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.745181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f35057-2ba0-4780-b662-5d7249abb9a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.746663 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f35057-2ba0-4780-b662-5d7249abb9a2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.841715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 593/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:55.847685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8cd1-448f-46aa-9dec-8993cf915a0c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.864676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.949594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8cd1-448f-46aa-9dec-8993cf915a0c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.982947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258515b0-7e35-47b4-a030-7bf9e0f6e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.983620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258515b0-7e35-47b4-a030-7bf9e0f6e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.983903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258515b0-7e35-47b4-a030-7bf9e0f6e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.984181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258515b0-7e35-47b4-a030-7bf9e0f6e4f6 None admin] PATH_INFO: `/v3/projects/341cd41044f448d9adff7b12e5a62f4d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.985332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258515b0-7e35-47b4-a030-7bf9e0f6e4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=341cd41044f448d9adff7b12e5a62f4d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.986785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258515b0-7e35-47b4-a030-7bf9e0f6e4f6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.988469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 606/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/projects/341cd41044f448d9adff7b12e5a62f4d => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:55.994629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f35057-2ba0-4780-b662-5d7249abb9a2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.021592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:56.091968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f35057-2ba0-4780-b662-5d7249abb9a2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.124524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6c30-797c-4be8-b532-c7803ff750a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.125129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6c30-797c-4be8-b532-c7803ff750a5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.125411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6c30-797c-4be8-b532-c7803ff750a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.125690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6c30-797c-4be8-b532-c7803ff750a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.126463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a6c30-797c-4be8-b532-c7803ff750a5 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=341cd41044f448d9adff7b12e5a62f4d, user.id=2eb166e85c964317b00b42772f8836cb) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:56.126773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a6c30-797c-4be8-b532-c7803ff750a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.128232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a6c30-797c-4be8-b532-c7803ff750a5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.134351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 594/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/role_assignments?user.id=2eb166e85c964317b00b42772f8836cb&scope.project.id=341cd41044f448d9adff7b12e5a62f4d&role.id=7a7079c0864e4bb7acaa71238097426e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:05.978809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=60 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:06.131793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=54 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:52.978858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77d1a-2275-470a-b78d-080511bdd820 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:52.979498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77d1a-2275-470a-b78d-080511bdd820 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:52.979498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77d1a-2275-470a-b78d-080511bdd820 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:52.981105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 607/1201] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:26:52.988434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb1858-55d6-42ba-ab6f-881c8fac4323 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:52.988434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb1858-55d6-42ba-ab6f-881c8fac4323 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:52.989399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb1858-55d6-42ba-ab6f-881c8fac4323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:53.014989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3adb1858-55d6-42ba-ab6f-881c8fac4323 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:53.016720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3adb1858-55d6-42ba-ab6f-881c8fac4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:53.137686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 595/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:26:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:53.173592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a77d1a-2275-470a-b78d-080511bdd820 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:53.371613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a77d1a-2275-470a-b78d-080511bdd820 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:53.434339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:53.435066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:53.435393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:53.437549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:53.456171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:53.461024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:53.478458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:53.483828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:53.484851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:53.484851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:53.484851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:53.484851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:26:53.484851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 608/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:53.488734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb1858-55d6-42ba-ab6f-881c8fac4323 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:53.637915 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb1858-55d6-42ba-ab6f-881c8fac4323 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:53.684103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:53.687555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643bcc1-13e2-4e67-b03d-a6cb07d94014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:53.688313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643bcc1-13e2-4e67-b03d-a6cb07d94014 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:53.688633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643bcc1-13e2-4e67-b03d-a6cb07d94014 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:53.689019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643bcc1-13e2-4e67-b03d-a6cb07d94014 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:53.689850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643bcc1-13e2-4e67-b03d-a6cb07d94014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:53.695636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643bcc1-13e2-4e67-b03d-a6cb07d94014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:53.695636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643bcc1-13e2-4e67-b03d-a6cb07d94014 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:53.704920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 596/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:53.711767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:53.816717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:53.880413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36270626-1e07-437b-bb36-ad0c295d5a90 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:53.930494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43d181-6ee7-4a7c-a599-ea95311cfd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:53.931447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d181-6ee7-4a7c-a599-ea95311cfd86 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:53.931872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d181-6ee7-4a7c-a599-ea95311cfd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:53.932226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d181-6ee7-4a7c-a599-ea95311cfd86 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:53.933168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43d181-6ee7-4a7c-a599-ea95311cfd86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:53.935084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43d181-6ee7-4a7c-a599-ea95311cfd86 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:53.964769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 609/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Aug 1 15:26:53 2022] POST /identity/v3/users => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:56.400478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c73a-d41d-4f0a-b286-571548fd084a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:56.401057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c73a-d41d-4f0a-b286-571548fd084a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:56.401447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c73a-d41d-4f0a-b286-571548fd084a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:56.403944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 597/1206] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:26:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:26:56.410632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecde95-c3be-489b-9250-fcc885504c2e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:56.411464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecde95-c3be-489b-9250-fcc885504c2e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:56.411464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecde95-c3be-489b-9250-fcc885504c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:56.439096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2eecde95-c3be-489b-9250-fcc885504c2e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:56.439096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2eecde95-c3be-489b-9250-fcc885504c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:56.536695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 610/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:26:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:56.562861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c73a-d41d-4f0a-b286-571548fd084a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:56.726630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c73a-d41d-4f0a-b286-571548fd084a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:56.777866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce537-3e02-4fdc-a996-678d4499f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:56.777866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce537-3e02-4fdc-a996-678d4499f129 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:56.777866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce537-3e02-4fdc-a996-678d4499f129 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:56.777866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce537-3e02-4fdc-a996-678d4499f129 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:56.785976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ce537-3e02-4fdc-a996-678d4499f129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b71ce537-3e02-4fdc-a996-678d4499f129 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:56.792215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:56.793366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:26:56.794402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:26:56.795595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 598/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:56.803403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecde95-c3be-489b-9250-fcc885504c2e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:56.858240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:56.950776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecde95-c3be-489b-9250-fcc885504c2e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:56.997880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:56.998807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:56.999440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:56.999920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:57.001170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:57.001465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:57.003057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:57.014488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 611/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:57.020609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce537-3e02-4fdc-a996-678d4499f129 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:57.093472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:57.179862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce537-3e02-4fdc-a996-678d4499f129 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:57.225294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:57.226213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:57.226594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:57.227152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:57.248863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:57.250627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:57.271230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:57.272728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:57.274219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:57.274219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:57.274219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:57.274219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:26:57.274219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 599/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:57.280804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:57.460178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:57.465521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553026b-0823-4f84-b1b8-6df24e6928c1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:57.534586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:57.536646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:57.536988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:57.537223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:57.538191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:57.538571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:57.540204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:57.564704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 612/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:57.571701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:57.711187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84bc81-a522-4c4b-a4ce-9c142541f052 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:57.712793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:57.752407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:57.753071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:57.753439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:57.753735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:57.762716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:57.764258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:26:57.788405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:57.789464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:26:57.790436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 600/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:26:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:57.798330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:57.947044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a281-fd63-4f48-b70b-8370a38ab363 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.000823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.001252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.001664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.002053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.003178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:58.003702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.007273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.034376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 613/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Aug 1 15:26:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:58.042629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:58.174241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119b4d1-08d0-4c8b-841f-43897d55ba6b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.222856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ac671-8a57-456a-9034-f8b6e33ec70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.223629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac671-8a57-456a-9034-f8b6e33ec70c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.223915 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac671-8a57-456a-9034-f8b6e33ec70c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.224192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac671-8a57-456a-9034-f8b6e33ec70c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.261549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:58.324091 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ac671-8a57-456a-9034-f8b6e33ec70c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.325919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ac671-8a57-456a-9034-f8b6e33ec70c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.452889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 601/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:58.459564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:58.492811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:58.627466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cebc07-9513-4c9f-a394-37f31d8b46e7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.686640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.689961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.690290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.690576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.704921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.706609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:58.725762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:58.726778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:58.727730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:58.727730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:58.727730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:58.727730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:26:58.732076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 614/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:58.734329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ac671-8a57-456a-9034-f8b6e33ec70c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:58.823264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:58.868812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ac671-8a57-456a-9034-f8b6e33ec70c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.914386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.915000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.915532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.915710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.916626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:58.917218 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.918700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.933283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 602/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:58.939605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:59.044126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:59.091170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fd4d7-f898-4c78-8910-a34bfad90e33 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:59.145508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:59.146284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:59.146680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:59.147215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:59.158055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:59.165591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:26:59.188370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:59.189470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:59.190391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:26:59.190391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:26:59.190391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:26:59.190391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:26:59.190391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:26:59.190391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:26:59.190391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:59.190391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:26:59.195566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 615/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:59.200955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:59.385001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dfee3-c986-48c6-b9e2-a96c58f9c465 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:59.432760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:59.450404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129bba3-9f65-43bd-a588-fceb15ef8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:59.451309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129bba3-9f65-43bd-a588-fceb15ef8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:59.451850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129bba3-9f65-43bd-a588-fceb15ef8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:59.452387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129bba3-9f65-43bd-a588-fceb15ef8bd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:59.453693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129bba3-9f65-43bd-a588-fceb15ef8bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:59.454047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129bba3-9f65-43bd-a588-fceb15ef8bd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:59.455794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129bba3-9f65-43bd-a588-fceb15ef8bd0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:59.472035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 603/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:59.479153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:59.635533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6b4e4-b0fb-44b8-a40e-e7fa6c392186 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:59.679062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:59.688896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6021fa-dbe3-4c16-ab8d-71b66d7e1be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:59.689659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6021fa-dbe3-4c16-ab8d-71b66d7e1be8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:59.689947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6021fa-dbe3-4c16-ab8d-71b66d7e1be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:59.690226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6021fa-dbe3-4c16-ab8d-71b66d7e1be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:59.691142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6021fa-dbe3-4c16-ab8d-71b66d7e1be8 None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=9365ba08205148e08c3a4f20d67125a3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:59.691499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6021fa-dbe3-4c16-ab8d-71b66d7e1be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:59.692980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6021fa-dbe3-4c16-ab8d-71b66d7e1be8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:59.700663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 616/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:26:59 2022] GET /identity/v3/role_assignments?user.id=9365ba08205148e08c3a4f20d67125a3&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:01.963240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa293b-defb-462c-8846-58691ba62e15 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:01.963896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa293b-defb-462c-8846-58691ba62e15 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:01.963896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa293b-defb-462c-8846-58691ba62e15 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:01.965198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 604/1220] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:27:01.971665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a26e4-8c41-4ef7-9aca-9dffc72a0061 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:01.972964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a26e4-8c41-4ef7-9aca-9dffc72a0061 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:01.972964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a26e4-8c41-4ef7-9aca-9dffc72a0061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:01.997573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c01a26e4-8c41-4ef7-9aca-9dffc72a0061 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:01.999174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c01a26e4-8c41-4ef7-9aca-9dffc72a0061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:02.101884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 617/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:02.136568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa293b-defb-462c-8846-58691ba62e15 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:02.325710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa293b-defb-462c-8846-58691ba62e15 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:02.371339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7bb92-e69e-48ac-90a1-bb746b65b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:02.372114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bb92-e69e-48ac-90a1-bb746b65b855 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:02.372436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bb92-e69e-48ac-90a1-bb746b65b855 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:02.372755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bb92-e69e-48ac-90a1-bb746b65b855 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:02.384223 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7bb92-e69e-48ac-90a1-bb746b65b855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f3f7bb92-e69e-48ac-90a1-bb746b65b855 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:27:02.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:02.391067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:02.392951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 605/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:02.398540 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a26e4-8c41-4ef7-9aca-9dffc72a0061 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:02.552209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a26e4-8c41-4ef7-9aca-9dffc72a0061 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:02.598316 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:02.612774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:02.613550 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:02.613830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:02.614108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:02.614837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:02.615281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:02.616834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:02.627195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 618/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:02.633502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7bb92-e69e-48ac-90a1-bb746b65b855 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:02.692452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:02.787959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7bb92-e69e-48ac-90a1-bb746b65b855 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:02.836533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:02.837184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:02.837499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:02.838004 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:02.856413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:02.858537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:02.881520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:02.889339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:02.891869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:02.891869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:02.891869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:02.891869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:02.891869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 606/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:02.896295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:03.036694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c8f1-a57b-49f5-8eae-cc6f268d0f51 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:03.077343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:03.077977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:03.078268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:03.078546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:03.079328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:03.079678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:03.081088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:03.094980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 619/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:03.108434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:03.234622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:03.246612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdc50c-ce33-46cc-ba02-6538848fa54a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:03.296070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:03.296801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:03.297119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:03.297424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:03.312378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:03.315062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:27:03.339058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:03.340553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:03.341857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 607/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:03.349707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:03.413103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:03.506679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174013d3-10d3-47bb-a437-324fa3bb0ee0 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:03.556787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:03.557524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:03.557862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:03.558357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:03.560305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:03.560305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:03.561326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:03.584865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 620/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Aug 1 15:27:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:03.592112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:03.719865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea71f67-21f5-487f-8946-ceadeed5c7d8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:03.766806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:03.768377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:03.769017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:03.770398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:03.788490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:03.790070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:03.806987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:03.808556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:03.814903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:03.814903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:03.814903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:03.814903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:03.814903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 608/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:03.817431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:03.973511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d59e7-fe7f-4d2d-a0d2-548fd433def9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:03.977344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:04.025125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:04.026050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:04.026344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:04.026629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:04.027337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:04.027681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:04.029085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:04.043764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 621/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:04.049800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:04.060014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:04.172573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183339ce-50ba-4a35-a25b-8bc566a93dd1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:04.219349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:04.220445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:04.220932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:04.221396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:04.232920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:04.234511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:27:04.249509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:04.251170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:04.252316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 609/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:04.257453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:04.394172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86014907-5479-4cda-ba2f-af75a5c58b4b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:04.439061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd45b17-ad88-4b1d-b91c-0b71f816627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:04.439869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45b17-ad88-4b1d-b91c-0b71f816627f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:04.440338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45b17-ad88-4b1d-b91c-0b71f816627f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:04.440631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45b17-ad88-4b1d-b91c-0b71f816627f None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:04.441714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd45b17-ad88-4b1d-b91c-0b71f816627f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:04.442178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd45b17-ad88-4b1d-b91c-0b71f816627f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:04.444032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd45b17-ad88-4b1d-b91c-0b71f816627f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:04.463338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 622/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:27:04.470031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:04.564104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:04.624294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8767c-af0a-4041-81cd-c9afeb176c2c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:04.687568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4dc85-94e0-4407-9de5-0d5fb7445f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:04.688398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4dc85-94e0-4407-9de5-0d5fb7445f7f None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:04.688651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4dc85-94e0-4407-9de5-0d5fb7445f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:04.688963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4dc85-94e0-4407-9de5-0d5fb7445f7f None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/9365ba08205148e08c3a4f20d67125a3/roles/b0731d356a6144c3a373a2085c88f855` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:04.709046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4dc85-94e0-4407-9de5-0d5fb7445f7f None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=9365ba08205148e08c3a4f20d67125a3, role_id=b0731d356a6144c3a373a2085c88f855)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:04.711351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4dc85-94e0-4407-9de5-0d5fb7445f7f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:04.729291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 610/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:27:04 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/9365ba08205148e08c3a4f20d67125a3/roles/b0731d356a6144c3a373a2085c88f855 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:27:06.855538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559fcd5-c206-4f99-876c-d4f4bebec928 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:06.856120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559fcd5-c206-4f99-876c-d4f4bebec928 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:06.856120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559fcd5-c206-4f99-876c-d4f4bebec928 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:06.857457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 623/1233] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:27:06.863084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def0a8c-bbf9-4fef-844e-94776cf92f63 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:06.863864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def0a8c-bbf9-4fef-844e-94776cf92f63 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:06.863864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def0a8c-bbf9-4fef-844e-94776cf92f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:06.883533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1def0a8c-bbf9-4fef-844e-94776cf92f63 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:06.884704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1def0a8c-bbf9-4fef-844e-94776cf92f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:06.978046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 611/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:07.009346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559fcd5-c206-4f99-876c-d4f4bebec928 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:07.038439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:07.137197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559fcd5-c206-4f99-876c-d4f4bebec928 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:07.172882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc20e8-77e2-4bed-b567-4269a4c5d371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:07.173538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc20e8-77e2-4bed-b567-4269a4c5d371 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:07.173824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc20e8-77e2-4bed-b567-4269a4c5d371 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:07.174105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc20e8-77e2-4bed-b567-4269a4c5d371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:07.185312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc20e8-77e2-4bed-b567-4269a4c5d371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c2bc20e8-77e2-4bed-b567-4269a4c5d371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:27:07.190347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:07.192053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:07.193089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 624/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Aug 1 15:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:27:07.202992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def0a8c-bbf9-4fef-844e-94776cf92f63 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:07.252565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:07.315249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def0a8c-bbf9-4fef-844e-94776cf92f63 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:07.358936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:07.359909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:07.360327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:07.360981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:07.362242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:07.363302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:07.365735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:07.379409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 612/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Aug 1 15:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:07.385724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc20e8-77e2-4bed-b567-4269a4c5d371 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:07.492345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:07.514992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc20e8-77e2-4bed-b567-4269a4c5d371 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:07.555060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:07.555748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:07.556032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:07.556315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:07.567888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:07.569542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:07.586716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:07.587824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:07.588741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:07.588741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:07.588741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:07.588741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:07.588741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 625/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:27:07.596819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:07.730397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d6dcb-733a-4f9e-8135-bf40c182a4fe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:07.746219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:07.783842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:07.784484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:07.785380 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:07.785668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:07.786356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:07.786659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:07.788061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:07.805437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 613/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:07.806909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:07.935536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1048-445a-4536-8e0a-fa01cba748b5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:07.987791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:07.988443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:07.988728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:07.989006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:07.993763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:08.002545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:08.004836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:27:08.017395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:08.018569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:08.020932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 626/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:08.025176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:08.138152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402622-b8ae-49de-8bee-09f42ff3b79e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:08.175893 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:08.176517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:08.176801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:08.177076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:08.177874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:08.178183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:08.179669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:08.204437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 614/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Aug 1 15:27:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:27:08.205754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:08.339734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56db310-bc6a-40ed-897a-a64a890760ee None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:08.376185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30aba14-69e2-4473-b0e9-9b0667bbff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:08.376944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aba14-69e2-4473-b0e9-9b0667bbff57 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:08.377288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aba14-69e2-4473-b0e9-9b0667bbff57 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:08.377632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aba14-69e2-4473-b0e9-9b0667bbff57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:08.447593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:08.455644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30aba14-69e2-4473-b0e9-9b0667bbff57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:08.457140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30aba14-69e2-4473-b0e9-9b0667bbff57 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:08.592995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 627/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:27:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:08.594363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:08.645114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:08.740281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753a848-c466-4e81-97e3-a9ed8fdc7abb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:08.794220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:08.795267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:08.795524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:08.795995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:08.809179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:08.810719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:08.829747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:08.831059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:08.832169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:08.832169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:08.832169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:08.832169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:08.832169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 615/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:08.837533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30aba14-69e2-4473-b0e9-9b0667bbff57 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:08.949114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:08.956150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30aba14-69e2-4473-b0e9-9b0667bbff57 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:08.995514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:08.996576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:08.997007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:08.997601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:08.999031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:08.999544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:09.001676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:09.020158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 628/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:27:09.026319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:09.141731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:09.169353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013041-30b2-404b-8411-e5dd6fc3f85d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:09.209062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:09.209587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:09.209872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:09.210148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:09.217750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:09.219397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:27:09.233109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:09.234852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:09.236600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 616/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:09.244108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:09.379785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a12b40-edab-4085-b8a0-34334b8edd8c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:09.423940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c50f6-6ad0-45cc-b20c-30c5818594dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:09.424687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c50f6-6ad0-45cc-b20c-30c5818594dc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:09.424974 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c50f6-6ad0-45cc-b20c-30c5818594dc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:09.425756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c50f6-6ad0-45cc-b20c-30c5818594dc None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:09.426602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c50f6-6ad0-45cc-b20c-30c5818594dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:09.426917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c50f6-6ad0-45cc-b20c-30c5818594dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:09.428427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c50f6-6ad0-45cc-b20c-30c5818594dc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:09.444204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 629/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:27:09.454798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:09.603927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871adef-378f-4fec-9bac-916376b3fb54 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:09.652424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c881659-a342-4db0-8117-ff1377ada70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:09.653052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c881659-a342-4db0-8117-ff1377ada70d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:09.653358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c881659-a342-4db0-8117-ff1377ada70d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:09.653659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c881659-a342-4db0-8117-ff1377ada70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:09.654698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c881659-a342-4db0-8117-ff1377ada70d None admin] RBAC: Adding query filter params (role.id=b0731d356a6144c3a373a2085c88f855, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=9365ba08205148e08c3a4f20d67125a3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:09.655014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c881659-a342-4db0-8117-ff1377ada70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:09.656486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c881659-a342-4db0-8117-ff1377ada70d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:09.679409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 617/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:27:09 2022] GET /identity/v3/role_assignments?user.id=9365ba08205148e08c3a4f20d67125a3&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=b0731d356a6144c3a373a2085c88f855 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:12.056344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250ea57-5242-4e3c-8121-b181048e3b37 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:12.056927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250ea57-5242-4e3c-8121-b181048e3b37 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:12.056927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250ea57-5242-4e3c-8121-b181048e3b37 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:12.058639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 630/1247] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:27:12.065402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f14088-04bc-4d5c-aea7-001e86401021 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:12.066604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f14088-04bc-4d5c-aea7-001e86401021 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:12.066604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f14088-04bc-4d5c-aea7-001e86401021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:12.073691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.092824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-24f14088-04bc-4d5c-aea7-001e86401021 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:12.094327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-24f14088-04bc-4d5c-aea7-001e86401021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:12.191319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 618/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:12.216651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250ea57-5242-4e3c-8121-b181048e3b37 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:12.242131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.348846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250ea57-5242-4e3c-8121-b181048e3b37 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:12.399824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5801e9-f1ad-4b67-8461-ed57d0d7f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:12.400510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5801e9-f1ad-4b67-8461-ed57d0d7f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:12.400790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5801e9-f1ad-4b67-8461-ed57d0d7f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:12.401068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5801e9-f1ad-4b67-8461-ed57d0d7f2f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:12.413820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5801e9-f1ad-4b67-8461-ed57d0d7f2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-dc5801e9-f1ad-4b67-8461-ed57d0d7f2f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:27:12.419691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:12.422271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:12.424187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 631/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:27:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:12.428925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f14088-04bc-4d5c-aea7-001e86401021 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:12.557072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f14088-04bc-4d5c-aea7-001e86401021 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:12.590704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.597589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:12.598495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:12.598806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:12.599188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:12.599974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:12.600336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:12.601828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:12.612311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 619/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:27:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:12.619237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5801e9-f1ad-4b67-8461-ed57d0d7f2f4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:12.732698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.766003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5801e9-f1ad-4b67-8461-ed57d0d7f2f4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:12.819658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:12.820605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:12.821039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:12.821447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:12.837257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:12.839033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:12.855875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:12.857462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:12.859215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:12.859215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:12.859215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:12.859215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:12.859215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 632/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:12.864972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:13.008097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cc448-1efd-4ac5-a44f-943424633709 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:13.052675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:13.053337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:13.053621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:13.053915 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:13.054639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:13.054950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:13.056387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:13.069886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 620/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:27:13.076314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:13.204111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ed484-0bba-473f-a507-a372f647220b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:13.239085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:13.249092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:13.249701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:13.249999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:13.250368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:13.259946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:13.261667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:27:13.276476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:13.277972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:13.279043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 633/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:27:13.284944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:13.367760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:13.421798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48157730-c321-4546-bc18-6542c6346c8a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:13.463797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:13.464467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:13.464848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:13.465245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:13.466147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:13.466689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:13.468564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:13.492992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 621/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Aug 1 15:27:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:13.500356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:13.662919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54c494-64f3-42aa-bf21-5e65db09ab69 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:13.705865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e731a-a675-4fac-ac92-4f496ef4fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:13.707242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e731a-a675-4fac-ac92-4f496ef4fb11 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:13.707559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e731a-a675-4fac-ac92-4f496ef4fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:13.707868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e731a-a675-4fac-ac92-4f496ef4fb11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:13.798977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:13.815244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e731a-a675-4fac-ac92-4f496ef4fb11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:13.817443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e731a-a675-4fac-ac92-4f496ef4fb11 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:13.951525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 634/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:27:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:27:13.958616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:14.101465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1ebb9-51b2-48ca-937b-60456400381c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:14.118236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:14.145677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:14.146494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.146782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.147051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.159473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:14.160773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:14.180895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:14.181941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:14.182965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:14.182965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:14.182965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:14.182965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:14.182965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 622/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:14.190213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e731a-a675-4fac-ac92-4f496ef4fb11 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:14.297531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:14.313239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e731a-a675-4fac-ac92-4f496ef4fb11 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:14.358326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:14.358880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.359159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.359472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.360163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:14.360464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:14.361825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:14.374095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 635/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:14.383029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:14.520229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011ae1-0343-4a9e-98da-f492c074aabb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:14.560722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:14.561382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.561700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.561935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.569962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:14.571454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:27:14.584154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:14.585248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:14.586237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 623/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:14.593930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:14.717107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609c447-cf0a-42fa-ae4b-168645bb89a5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:14.757824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6ba6d-79eb-4dbf-a6cd-87b98a0c8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:14.758632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ba6d-79eb-4dbf-a6cd-87b98a0c8551 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.759090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ba6d-79eb-4dbf-a6cd-87b98a0c8551 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.759263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ba6d-79eb-4dbf-a6cd-87b98a0c8551 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.760091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6ba6d-79eb-4dbf-a6cd-87b98a0c8551 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:14.760393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6ba6d-79eb-4dbf-a6cd-87b98a0c8551 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:14.762015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6ba6d-79eb-4dbf-a6cd-87b98a0c8551 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:14.777094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 636/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:14.783708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:14.818134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:14.922707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f3843-e9bd-4f0c-9bdc-b6090431eec5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:14.970514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced3b8f-bbf1-458b-abca-49b0a09772ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:14.971184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced3b8f-bbf1-458b-abca-49b0a09772ec None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.971625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced3b8f-bbf1-458b-abca-49b0a09772ec None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.972567 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced3b8f-bbf1-458b-abca-49b0a09772ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.973494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced3b8f-bbf1-458b-abca-49b0a09772ec None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=9365ba08205148e08c3a4f20d67125a3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:14.973951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced3b8f-bbf1-458b-abca-49b0a09772ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:14.975616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced3b8f-bbf1-458b-abca-49b0a09772ec None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:14.983103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 624/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:27:14 2022] GET /identity/v3/role_assignments?user.id=9365ba08205148e08c3a4f20d67125a3&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=7a7079c0864e4bb7acaa71238097426e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:17.128253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e15fb-1156-4e71-a12d-39022ad9abb4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.128835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e15fb-1156-4e71-a12d-39022ad9abb4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.128952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e15fb-1156-4e71-a12d-39022ad9abb4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.131304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 637/1261] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:27:17.138054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd89d9b-5046-4d6a-b8c9-66dc314da52e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.138641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd89d9b-5046-4d6a-b8c9-66dc314da52e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.138641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd89d9b-5046-4d6a-b8c9-66dc314da52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.161876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3bd89d9b-5046-4d6a-b8c9-66dc314da52e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:17.163089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3bd89d9b-5046-4d6a-b8c9-66dc314da52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:17.245332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 625/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:17.266259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e15fb-1156-4e71-a12d-39022ad9abb4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:17.278061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:17.391484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e15fb-1156-4e71-a12d-39022ad9abb4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:17.429194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d008-f038-4b43-b0a2-43b2397ea408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:17.429860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d008-f038-4b43-b0a2-43b2397ea408 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.430142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d008-f038-4b43-b0a2-43b2397ea408 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.430425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d008-f038-4b43-b0a2-43b2397ea408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.442623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683d008-f038-4b43-b0a2-43b2397ea408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9683d008-f038-4b43-b0a2-43b2397ea408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:27:17.447829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:17.449577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:17.451117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 638/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:27:17.455761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd89d9b-5046-4d6a-b8c9-66dc314da52e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:17.477308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:17.594746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd89d9b-5046-4d6a-b8c9-66dc314da52e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:17.655140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:17.656051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.656506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.656929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.658040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:17.658518 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:17.661349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:17.674664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 626/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:17.680148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d008-f038-4b43-b0a2-43b2397ea408 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:17.777322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:17.814749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d008-f038-4b43-b0a2-43b2397ea408 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:17.853336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:17.853988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.854271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.854545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.865247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:17.866706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:17.883115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:17.884308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:17.885388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:17.885388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:17.885388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:17.885388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:17.885388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 639/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:17.890109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:17.973127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:17.992523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c9a5-b86f-458e-9706-b732b81269ca None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:18.028511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:18.029044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:18.029310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:18.029564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.030261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:18.030563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.032051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.045154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 627/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:18.050933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:18.155785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3ae5b-6fc6-4493-9cec-902ff1d0528d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:18.177272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:18.192449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:18.193084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:18.193364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:18.193637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.201305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.202742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:27:18.214208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:18.215367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:18.221288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 640/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:18.222097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:18.332393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c0d0-e29e-4c62-ac63-9166c9487e3b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:18.370410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:18.371029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:18.371311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:18.371613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.372411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:18.372721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.374311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.383754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:18.392425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 628/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Aug 1 15:27:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:18.398204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:18.502657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4cca7-d333-48eb-ab8c-81304f8bf152 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:18.538475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:18.539113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:18.539418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:18.539692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.551141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.552621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:18.567350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:18.568847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:18.570000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:18.570000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:18.570000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:18.570000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:18.570000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 641/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:18.574251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:18.677421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cb61a-0f4c-431d-8d79-34c61cc9ac75 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:18.710700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:18.711320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:18.711633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:18.711905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.712589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:18.712890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.714322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.726877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 629/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:18.733180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:18.771632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:18.841338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3d095-193c-4da5-a3c4-32b1178d08cd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:18.876226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:18.876860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:18.877138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:18.877409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.884566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.886022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:27:18.897414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:18.898496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:18.904374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 642/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:18.905061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:18.963971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:19.008564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8ce2e-c684-46a9-8eed-e4965e8fc8c3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:19.048731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccf1a0-93ac-4731-be5b-1a9b6d872821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:19.049357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf1a0-93ac-4731-be5b-1a9b6d872821 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:19.049642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf1a0-93ac-4731-be5b-1a9b6d872821 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:19.049919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf1a0-93ac-4731-be5b-1a9b6d872821 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:19.050672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccf1a0-93ac-4731-be5b-1a9b6d872821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:19.050987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccf1a0-93ac-4731-be5b-1a9b6d872821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:19.052463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccf1a0-93ac-4731-be5b-1a9b6d872821 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:19.064748 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 630/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:19.070825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:19.165735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:19.175591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b735bef-6224-4a96-aad0-4e57b4424caa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:19.209204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09df8b-d011-494d-b2e0-50d163553b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:19.209867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09df8b-d011-494d-b2e0-50d163553b7a None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:19.210162 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09df8b-d011-494d-b2e0-50d163553b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:19.210486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09df8b-d011-494d-b2e0-50d163553b7a None admin] PATH_INFO: `/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/9365ba08205148e08c3a4f20d67125a3/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:19.212427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09df8b-d011-494d-b2e0-50d163553b7a None admin] RBAC: Authorizing `identity:create_grant(project_id=fc2830c7535e40c3a0c47b50d9d8fa89, user_id=9365ba08205148e08c3a4f20d67125a3, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:19.213857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09df8b-d011-494d-b2e0-50d163553b7a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:19.227752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 643/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Aug 1 15:27:19 2022] PUT /identity/v3/projects/fc2830c7535e40c3a0c47b50d9d8fa89/users/9365ba08205148e08c3a4f20d67125a3/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:27:21.287678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739f1d-c3b0-4349-b8b7-f0314d85edb9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:21.288292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739f1d-c3b0-4349-b8b7-f0314d85edb9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:21.288292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739f1d-c3b0-4349-b8b7-f0314d85edb9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:21.289628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 631/1274] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:27:21.295351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724b09d-05be-40c9-a645-8b20e77e9a2c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:21.295824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724b09d-05be-40c9-a645-8b20e77e9a2c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:21.296027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724b09d-05be-40c9-a645-8b20e77e9a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:21.314885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f724b09d-05be-40c9-a645-8b20e77e9a2c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:21.316684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f724b09d-05be-40c9-a645-8b20e77e9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:21.384799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 644/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:21.408693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de739f1d-c3b0-4349-b8b7-f0314d85edb9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:21.514176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de739f1d-c3b0-4349-b8b7-f0314d85edb9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:21.535938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:21.554334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abe8ab-a6e4-4270-8877-defb477c35f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:21.554977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe8ab-a6e4-4270-8877-defb477c35f8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:21.555256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe8ab-a6e4-4270-8877-defb477c35f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:21.555560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe8ab-a6e4-4270-8877-defb477c35f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:21.567127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abe8ab-a6e4-4270-8877-defb477c35f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e3abe8ab-a6e4-4270-8877-defb477c35f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:27:21.572125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:21.573338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:21.574917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 632/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Aug 1 15:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:21.579698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724b09d-05be-40c9-a645-8b20e77e9a2c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:21.674703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:21.705821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724b09d-05be-40c9-a645-8b20e77e9a2c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:21.758685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:21.759320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:21.759627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:21.759901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:21.760624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:21.760929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:21.762314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:21.773030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 645/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Aug 1 15:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:21.779620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abe8ab-a6e4-4270-8877-defb477c35f8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:21.888224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abe8ab-a6e4-4270-8877-defb477c35f8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:21.923227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:21.923890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:21.924170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:21.924437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:21.935731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:21.937177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:21.951794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:21.952849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:21.953981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:21.953981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:21.953981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:21.953981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:21.953981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 633/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:27:21.960007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:22.068214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55078f6e-3145-43e4-9075-447e2c16fdb8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:22.105111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:22.105736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:22.106016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:22.106290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:22.106980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:22.107286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:22.108850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:22.123055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 646/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:27:22.129880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:22.174275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:22.264350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69c39f-c701-418e-9466-d2c47bda9559 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:22.302340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:22.303205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:22.303416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:22.303596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:22.311797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:22.313540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:27:22.326653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:22.328582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:22.330542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 634/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:27:22.334926 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:22.340110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:22.457828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef5032-d712-426c-b0ce-b39cc38d8d33 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:22.499558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:22.500189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:22.500471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:22.500753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:22.501560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:22.501868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:22.503853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:22.522986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 647/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Aug 1 15:27:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:22.529288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:22.629891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:22.641799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ec97-0105-4fe7-b711-336f08ed808e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:22.688310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be9e5-3263-4e57-8c39-eb0dc80fdafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:22.688933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be9e5-3263-4e57-8c39-eb0dc80fdafe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:22.689213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be9e5-3263-4e57-8c39-eb0dc80fdafe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:22.689487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be9e5-3263-4e57-8c39-eb0dc80fdafe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:22.760599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605be9e5-3263-4e57-8c39-eb0dc80fdafe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:22.762074 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605be9e5-3263-4e57-8c39-eb0dc80fdafe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:22.851155 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:22.862066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 635/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Aug 1 15:27:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:22.868391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:22.930807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:22.970523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a84034-6e50-44e5-8cb5-d068df380528 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:23.006761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:23.007423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:23.007709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:23.007981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:23.018081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:23.019635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:23.034449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:23.035596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:23.036841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:27:23.036841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:23.036841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:27:23.036841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:23.036841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 648/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:23.041545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be9e5-3263-4e57-8c39-eb0dc80fdafe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:23.145753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be9e5-3263-4e57-8c39-eb0dc80fdafe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:23.181595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:23.182115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:23.182478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:23.182853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:23.183569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:23.183876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:23.185243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:23.196454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 636/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Aug 1 15:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:23.202249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:23.308651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7004eb-264c-4ea9-994d-f0375421bb7a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:23.323484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:23.345230 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:23.345881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:23.346151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:23.346427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:23.353730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:23.355186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:27:23.367173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:23.368128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 01 15:27:23.369019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 649/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Aug 1 15:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:23.374433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:23.425598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:23.476051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152cf3f-a919-4ac9-b00b-1c31899fc5ca None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:23.508829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9bfd6-e4d7-4862-a363-0fe6abe4df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:23.509447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bfd6-e4d7-4862-a363-0fe6abe4df77 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:23.509729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bfd6-e4d7-4862-a363-0fe6abe4df77 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:23.510002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bfd6-e4d7-4862-a363-0fe6abe4df77 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:23.510746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9bfd6-e4d7-4862-a363-0fe6abe4df77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:23.511052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9bfd6-e4d7-4862-a363-0fe6abe4df77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:23.512587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9bfd6-e4d7-4862-a363-0fe6abe4df77 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:23.525349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 637/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Aug 1 15:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:23.531636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:23.634218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ab602-572b-41f8-a94b-a1cd5a95af39 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:23.668147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad079b58-bff4-4d73-94a4-d5ccff290440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:23.668761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079b58-bff4-4d73-94a4-d5ccff290440 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:23.669046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079b58-bff4-4d73-94a4-d5ccff290440 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:23.669321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079b58-bff4-4d73-94a4-d5ccff290440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:23.670101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad079b58-bff4-4d73-94a4-d5ccff290440 None admin] RBAC: Adding query filter params (role.id=7a7079c0864e4bb7acaa71238097426e, scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89, user.id=9365ba08205148e08c3a4f20d67125a3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:23.670414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad079b58-bff4-4d73-94a4-d5ccff290440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:23.671883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad079b58-bff4-4d73-94a4-d5ccff290440 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:23.677597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 650/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Aug 1 15:27:23 2022] GET /identity/v3/role_assignments?user.id=9365ba08205148e08c3a4f20d67125a3&scope.project.id=fc2830c7535e40c3a0c47b50d9d8fa89&role.id=7a7079c0864e4bb7acaa71238097426e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:25.693765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0abfc-e7aa-4d24-812f-25d5ec75abc9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:25.694326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0abfc-e7aa-4d24-812f-25d5ec75abc9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:25.694326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0abfc-e7aa-4d24-812f-25d5ec75abc9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:25.695671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 638/1288] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:27:25.700777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99321b5-707e-4508-9dd8-7ee38225a677 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:25.701161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99321b5-707e-4508-9dd8-7ee38225a677 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:25.701336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99321b5-707e-4508-9dd8-7ee38225a677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:25.720502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f99321b5-707e-4508-9dd8-7ee38225a677 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:25.721703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f99321b5-707e-4508-9dd8-7ee38225a677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:25.763057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:25.807458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 651/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:25.835245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0abfc-e7aa-4d24-812f-25d5ec75abc9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:25.935902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0abfc-e7aa-4d24-812f-25d5ec75abc9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:25.947066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:25.969955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:25.970588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:25.970881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:25.971161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:25.971939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:25.973475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:25.982848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:25.984121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:25.985050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 639/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:27:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:25.990727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99321b5-707e-4508-9dd8-7ee38225a677 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:26.099273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99321b5-707e-4508-9dd8-7ee38225a677 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:26.132705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f1ba-7da8-4790-8232-660f5a2aeff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:26.133319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f1ba-7da8-4790-8232-660f5a2aeff6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:26.133596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f1ba-7da8-4790-8232-660f5a2aeff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:26.133868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f1ba-7da8-4790-8232-660f5a2aeff6 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:26.134536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23f1ba-7da8-4790-8232-660f5a2aeff6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:26.134838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23f1ba-7da8-4790-8232-660f5a2aeff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:26.136238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23f1ba-7da8-4790-8232-660f5a2aeff6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:26.141029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 652/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Mon Aug 1 15:27:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:26.146892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:26.245475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a386a-6907-46a2-8e12-e3788a810c28 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:26.278108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1662fe-d6d7-47eb-b448-0e719133a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:26.278721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1662fe-d6d7-47eb-b448-0e719133a877 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:26.279166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1662fe-d6d7-47eb-b448-0e719133a877 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:26.279326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1662fe-d6d7-47eb-b448-0e719133a877 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:26.280112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1662fe-d6d7-47eb-b448-0e719133a877 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:26.280333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1662fe-d6d7-47eb-b448-0e719133a877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:26.281702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1662fe-d6d7-47eb-b448-0e719133a877 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:26.286611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 640/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Mon Aug 1 15:27:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:28.266840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a819-5c9f-4c54-8ce1-1195db5299e5 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:28.267493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a819-5c9f-4c54-8ce1-1195db5299e5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:28.267493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a819-5c9f-4c54-8ce1-1195db5299e5 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:28.269286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 653/1293] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:27:28.276469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bde02-801b-4ff5-8d2d-1842bfa7e3c6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:28.276927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bde02-801b-4ff5-8d2d-1842bfa7e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:28.277061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bde02-801b-4ff5-8d2d-1842bfa7e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:28.295824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-eb3bde02-801b-4ff5-8d2d-1842bfa7e3c6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:28.297019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-eb3bde02-801b-4ff5-8d2d-1842bfa7e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:28.326468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:28.363513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 641/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:28.386303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5a819-5c9f-4c54-8ce1-1195db5299e5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:28.417806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:28.489116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5a819-5c9f-4c54-8ce1-1195db5299e5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:28.524317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1678a5-a448-49ea-971d-bda4b357112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:28.524935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1678a5-a448-49ea-971d-bda4b357112c None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:28.525235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1678a5-a448-49ea-971d-bda4b357112c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:28.525493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1678a5-a448-49ea-971d-bda4b357112c None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:28.526190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1678a5-a448-49ea-971d-bda4b357112c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:28.527588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1678a5-a448-49ea-971d-bda4b357112c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:28.541714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 654/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Aug 1 15:27:28 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:27:30.540398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef5785-3da6-4d11-97b8-dc8f762f246b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:30.541007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef5785-3da6-4d11-97b8-dc8f762f246b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:30.541007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef5785-3da6-4d11-97b8-dc8f762f246b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:30.542317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 642/1296] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:27:30.547585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa343fe-dfc8-4378-bef1-3419bb5900e7 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:30.547960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa343fe-dfc8-4378-bef1-3419bb5900e7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:30.548139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa343fe-dfc8-4378-bef1-3419bb5900e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:30.566806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3fa343fe-dfc8-4378-bef1-3419bb5900e7 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:30.568012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3fa343fe-dfc8-4378-bef1-3419bb5900e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:30.638930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 655/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:30.661283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef5785-3da6-4d11-97b8-dc8f762f246b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:30.770085 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef5785-3da6-4d11-97b8-dc8f762f246b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:30.813525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:30.814115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:30.814364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:30.814699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:30.815436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:30.816802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:30.825654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:30.826856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:30.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 643/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:27:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:30.833089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa343fe-dfc8-4378-bef1-3419bb5900e7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:30.851805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:30.934151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa343fe-dfc8-4378-bef1-3419bb5900e7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:30.967779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:30.968396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:30.968677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:30.968950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:30.969621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:30.969926 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:30.971291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:30.977612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 656/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Mon Aug 1 15:27:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:30.983834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:31.015183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:31.084991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b7dac-c53a-4141-b90d-a466ed5b4d43 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:31.117758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec1961-b135-4d2d-9c8e-b0a5423a6037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:31.118374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1961-b135-4d2d-9c8e-b0a5423a6037 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:31.118656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1961-b135-4d2d-9c8e-b0a5423a6037 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:31.118932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1961-b135-4d2d-9c8e-b0a5423a6037 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:31.119710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec1961-b135-4d2d-9c8e-b0a5423a6037 None admin] RBAC: Adding query filter params (interface=public, service_id=a4ea874b1ccc4a058b6ca88a0e9d0f0e, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:31.120023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec1961-b135-4d2d-9c8e-b0a5423a6037 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:31.121430 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec1961-b135-4d2d-9c8e-b0a5423a6037 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:31.126672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 644/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Aug 1 15:27:30 2022] GET /identity/v3/endpoints?service_id=a4ea874b1ccc4a058b6ca88a0e9d0f0e&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:31.132541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:31.218880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:31.241335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1658b9-b543-4630-aeba-6aab4c4f90cd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:31.275133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e5818-ed44-46fc-8001-ea7486e25a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:31.275783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e5818-ed44-46fc-8001-ea7486e25a35 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:31.276070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e5818-ed44-46fc-8001-ea7486e25a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:31.276348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e5818-ed44-46fc-8001-ea7486e25a35 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:31.277003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e5818-ed44-46fc-8001-ea7486e25a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:31.278378 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e5818-ed44-46fc-8001-ea7486e25a35 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:31.286014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 657/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Aug 1 15:27:31 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:27:33.333621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55d4a-0d08-466f-97c1-5b67bc2df314 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:33.334167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55d4a-0d08-466f-97c1-5b67bc2df314 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:33.334167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55d4a-0d08-466f-97c1-5b67bc2df314 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:33.335563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 645/1302] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:27:33.340811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81740a6a-a534-4c98-b7ed-d6ef4fa07a76 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:33.341238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81740a6a-a534-4c98-b7ed-d6ef4fa07a76 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:33.341655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81740a6a-a534-4c98-b7ed-d6ef4fa07a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:33.360342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-81740a6a-a534-4c98-b7ed-d6ef4fa07a76 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:33.361518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-81740a6a-a534-4c98-b7ed-d6ef4fa07a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:33.428499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 658/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:27:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:33.450489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a55d4a-0d08-466f-97c1-5b67bc2df314 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:33.549325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:33.556274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a55d4a-0d08-466f-97c1-5b67bc2df314 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:33.592030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:33.592688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:33.593001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:33.593318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:33.594008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:33.595394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:33.604581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:33.605745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 01 15:27:33.607058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 646/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Aug 1 15:27:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:33.611832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81740a6a-a534-4c98-b7ed-d6ef4fa07a76 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:33.686328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:33.709980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81740a6a-a534-4c98-b7ed-d6ef4fa07a76 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:33.748537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5408a-9276-47c0-b2a3-cbfe885bca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:33.749183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5408a-9276-47c0-b2a3-cbfe885bca5d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:33.749497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5408a-9276-47c0-b2a3-cbfe885bca5d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:33.749777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5408a-9276-47c0-b2a3-cbfe885bca5d None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:33.750464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5408a-9276-47c0-b2a3-cbfe885bca5d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:33.750772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5408a-9276-47c0-b2a3-cbfe885bca5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:33.752226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5408a-9276-47c0-b2a3-cbfe885bca5d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:33.758809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 659/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Mon Aug 1 15:27:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:33.767884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:33.871997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842876d-7da0-4b15-9d64-92865f273ffb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:33.905962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2008e-5b68-421d-a0b6-e376ef8d09d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:33.906583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2008e-5b68-421d-a0b6-e376ef8d09d0 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:33.906865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2008e-5b68-421d-a0b6-e376ef8d09d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:33.907187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2008e-5b68-421d-a0b6-e376ef8d09d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:33.907934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2008e-5b68-421d-a0b6-e376ef8d09d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:33.909348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2008e-5b68-421d-a0b6-e376ef8d09d0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:33.934050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 647/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:27:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:27:43.755244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=30 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:43.929754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:38.126728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45255c5f-33be-407b-bdd3-a158da21cbc8 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.127205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45255c5f-33be-407b-bdd3-a158da21cbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.127284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45255c5f-33be-407b-bdd3-a158da21cbc8 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.128725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 660/1307] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:38.134453 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a37ad-4f01-4cb0-8364-400a65c7e70e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.134964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a37ad-4f01-4cb0-8364-400a65c7e70e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.135045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a37ad-4f01-4cb0-8364-400a65c7e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.228613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dd3a37ad-4f01-4cb0-8364-400a65c7e70e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:38.229720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dd3a37ad-4f01-4cb0-8364-400a65c7e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:38.365259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 648/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:38.437535 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc04acf-ac6f-463d-a177-7c5e32145d13 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.437827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc04acf-ac6f-463d-a177-7c5e32145d13 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.438110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc04acf-ac6f-463d-a177-7c5e32145d13 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.439518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 661/1309] 10.222.0.71 () {54 vars in 965 bytes} [Mon Aug 1 15:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:38.455554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e496-225b-4768-b7ff-84deadbf7484 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.455946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e496-225b-4768-b7ff-84deadbf7484 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.457044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e496-225b-4768-b7ff-84deadbf7484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.603876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e169e496-225b-4768-b7ff-84deadbf7484 None None] MFA Rules not processed for user `1a1f3e1faeba451488854da4236359ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:38.605244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e169e496-225b-4768-b7ff-84deadbf7484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:38.635269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:38.696514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 649/1310] 10.222.0.71 () {58 vars in 1062 bytes} [Mon Aug 1 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:38.705731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc04acf-ac6f-463d-a177-7c5e32145d13 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:38.708268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7bc04acf-ac6f-463d-a177-7c5e32145d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:38.842841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc04acf-ac6f-463d-a177-7c5e32145d13 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:38.935539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc34beb-76ad-4c28-b6f3-5a75c531925b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:38.936577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34beb-76ad-4c28-b6f3-5a75c531925b service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.936963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34beb-76ad-4c28-b6f3-5a75c531925b service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.937362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34beb-76ad-4c28-b6f3-5a75c531925b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.939148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5fc34beb-76ad-4c28-b6f3-5a75c531925b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:39.014165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:39.113904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc34beb-76ad-4c28-b6f3-5a75c531925b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:39.115700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc34beb-76ad-4c28-b6f3-5a75c531925b service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:39.157278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 662/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:28:41.562942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f381-3f79-4eb3-8a4b-d4a21bdb5410 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:41.563534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f381-3f79-4eb3-8a4b-d4a21bdb5410 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:41.563534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f381-3f79-4eb3-8a4b-d4a21bdb5410 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:41.565033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 650/1312] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:41.570697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46069-ff88-47a9-8a6b-57184396d4fd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:41.571119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46069-ff88-47a9-8a6b-57184396d4fd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:41.571259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46069-ff88-47a9-8a6b-57184396d4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:41.644241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-22b46069-ff88-47a9-8a6b-57184396d4fd None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:41.645458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-22b46069-ff88-47a9-8a6b-57184396d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:41.745175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 663/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:41.785260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f381-3f79-4eb3-8a4b-d4a21bdb5410 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:41.787031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1662f381-3f79-4eb3-8a4b-d4a21bdb5410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:41.899565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f381-3f79-4eb3-8a4b-d4a21bdb5410 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:41.971497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:41.974328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a1053-b1c1-4709-a43b-3fa7b364cea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:41.975138 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a1053-b1c1-4709-a43b-3fa7b364cea4 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:41.975638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a1053-b1c1-4709-a43b-3fa7b364cea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:41.976119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a1053-b1c1-4709-a43b-3fa7b364cea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:41.977771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-195a1053-b1c1-4709-a43b-3fa7b364cea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:42.089832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a1053-b1c1-4709-a43b-3fa7b364cea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:42.091517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a1053-b1c1-4709-a43b-3fa7b364cea4 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:42.109906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 651/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:28:44.413514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d7df-3ca2-4b06-811b-6c1243b1442f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.414025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d7df-3ca2-4b06-811b-6c1243b1442f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.414025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d7df-3ca2-4b06-811b-6c1243b1442f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.415330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 664/1315] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:44.420710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d835dd8-523b-46fa-8218-5a61437ba1a7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.421126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d835dd8-523b-46fa-8218-5a61437ba1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.421260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d835dd8-523b-46fa-8218-5a61437ba1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.485081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0d835dd8-523b-46fa-8218-5a61437ba1a7 None None] MFA Rules not processed for user `0db8cbec685146f29926d156e74d541f`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:44.486299 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0d835dd8-523b-46fa-8218-5a61437ba1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:44.537768 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:44.582722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 652/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:44.637440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b87be-dfbe-4316-b844-a3395704821d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.637727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b87be-dfbe-4316-b844-a3395704821d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.638009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b87be-dfbe-4316-b844-a3395704821d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.639398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 665/1317] 10.222.0.71 () {54 vars in 965 bytes} [Mon Aug 1 15:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:44.646091 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902414-e25f-4751-8fb5-35b1db39c368 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.646377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902414-e25f-4751-8fb5-35b1db39c368 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.646676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902414-e25f-4751-8fb5-35b1db39c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.724533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-72902414-e25f-4751-8fb5-35b1db39c368 None None] MFA Rules not processed for user `1a1f3e1faeba451488854da4236359ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:44.725916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-72902414-e25f-4751-8fb5-35b1db39c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:44.800498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 653/1318] 10.222.0.71 () {58 vars in 1062 bytes} [Mon Aug 1 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:44.809704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b87be-dfbe-4316-b844-a3395704821d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:44.811249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9c2b87be-dfbe-4316-b844-a3395704821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:44.821292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:44.916809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b87be-dfbe-4316-b844-a3395704821d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:44.989731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cd0a-1391-46a0-a7c6-18a554aaf40e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:44.990273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd0a-1391-46a0-a7c6-18a554aaf40e service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.990555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd0a-1391-46a0-a7c6-18a554aaf40e service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.990829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd0a-1391-46a0-a7c6-18a554aaf40e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.992495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a982cd0a-1391-46a0-a7c6-18a554aaf40e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:45.055399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:45.102952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cd0a-1391-46a0-a7c6-18a554aaf40e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:45.104423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cd0a-1391-46a0-a7c6-18a554aaf40e service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:45.122547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 666/1319] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:28:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:28:48.058008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f1e7f-02c4-4969-9a06-1b3201f6d924 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:48.058606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f1e7f-02c4-4969-9a06-1b3201f6d924 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:48.058606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f1e7f-02c4-4969-9a06-1b3201f6d924 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.059943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 654/1320] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:48.065095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5a0d-50aa-4c45-af6a-8091c9833cb4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:48.066040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5a0d-50aa-4c45-af6a-8091c9833cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:48.066208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5a0d-50aa-4c45-af6a-8091c9833cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.133037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ecdd5a0d-50aa-4c45-af6a-8091c9833cb4 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:48.134243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ecdd5a0d-50aa-4c45-af6a-8091c9833cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:48.232788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 667/1321] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:48.271920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f1e7f-02c4-4969-9a06-1b3201f6d924 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:48.273459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-471f1e7f-02c4-4969-9a06-1b3201f6d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:48.322582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:48.374752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f1e7f-02c4-4969-9a06-1b3201f6d924 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:48.446169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71260053-592d-4a97-a365-57b675eec92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:48.446783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71260053-592d-4a97-a365-57b675eec92c service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:48.447058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71260053-592d-4a97-a365-57b675eec92c service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:48.447327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71260053-592d-4a97-a365-57b675eec92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.448950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-71260053-592d-4a97-a365-57b675eec92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:48.540416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:48.553828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71260053-592d-4a97-a365-57b675eec92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:48.555256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71260053-592d-4a97-a365-57b675eec92c service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:48.573963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 655/1322] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:28:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:28:51.332473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d01a0-4ffc-482d-92c8-bf3b1544e60b None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.333070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d01a0-4ffc-482d-92c8-bf3b1544e60b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.333070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d01a0-4ffc-482d-92c8-bf3b1544e60b None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.334521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 668/1323] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:51.339696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d7ae-65f4-4dbd-b66c-1fb881dc7ae8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.340092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d7ae-65f4-4dbd-b66c-1fb881dc7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.340414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d7ae-65f4-4dbd-b66c-1fb881dc7ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.409820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-06c3d7ae-65f4-4dbd-b66c-1fb881dc7ae8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:51.411032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-06c3d7ae-65f4-4dbd-b66c-1fb881dc7ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:51.515398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 656/1324] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:51.553423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d01a0-4ffc-482d-92c8-bf3b1544e60b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:51.555069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-786d01a0-4ffc-482d-92c8-bf3b1544e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:51.575801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.671946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d01a0-4ffc-482d-92c8-bf3b1544e60b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:51.749371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaea42-d601-493a-b0b4-14c6e2c8299e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:51.749999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaea42-d601-493a-b0b4-14c6e2c8299e service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.750313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaea42-d601-493a-b0b4-14c6e2c8299e service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.750584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaea42-d601-493a-b0b4-14c6e2c8299e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.752263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-69eaea42-d601-493a-b0b4-14c6e2c8299e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:51.823776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.865299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaea42-d601-493a-b0b4-14c6e2c8299e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:51.866773 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaea42-d601-493a-b0b4-14c6e2c8299e service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:51.885248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 669/1325] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:28:53.992654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bfc4b-8897-40c7-b744-eb271a4de9e9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:53.993177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bfc4b-8897-40c7-b744-eb271a4de9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:53.993177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bfc4b-8897-40c7-b744-eb271a4de9e9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:53.994455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 657/1326] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:53.999661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611c5a8-441e-4aa1-af09-845f94f75bae None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:54.000101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611c5a8-441e-4aa1-af09-845f94f75bae None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:54.000299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611c5a8-441e-4aa1-af09-845f94f75bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:54.067332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4611c5a8-441e-4aa1-af09-845f94f75bae None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:54.068566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4611c5a8-441e-4aa1-af09-845f94f75bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:54.171073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 670/1327] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:28:54.208410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bfc4b-8897-40c7-b744-eb271a4de9e9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:54.210084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4d1bfc4b-8897-40c7-b744-eb271a4de9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:54.275971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:54.321469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bfc4b-8897-40c7-b744-eb271a4de9e9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:54.396658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c87e8f-5016-434b-9a36-0073dc089283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:54.397301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c87e8f-5016-434b-9a36-0073dc089283 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:54.397597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c87e8f-5016-434b-9a36-0073dc089283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:54.397875 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c87e8f-5016-434b-9a36-0073dc089283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:54.399651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-19c87e8f-5016-434b-9a36-0073dc089283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:54.520682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:54.523876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c87e8f-5016-434b-9a36-0073dc089283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:54.525945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c87e8f-5016-434b-9a36-0073dc089283 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:54.546289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 658/1328] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:28:56.662955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06650-0628-4016-a368-85d61096204f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:56.663523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06650-0628-4016-a368-85d61096204f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:56.663608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06650-0628-4016-a368-85d61096204f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:56.665139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 671/1329] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:56.670972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809c11e-989c-4996-9d2d-b98f9149b92e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:56.671437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809c11e-989c-4996-9d2d-b98f9149b92e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:56.671706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809c11e-989c-4996-9d2d-b98f9149b92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:56.739478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9809c11e-989c-4996-9d2d-b98f9149b92e None None] MFA Rules not processed for user `0db8cbec685146f29926d156e74d541f`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:56.740642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9809c11e-989c-4996-9d2d-b98f9149b92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:56.844312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 659/1330] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:56.882820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece06650-0628-4016-a368-85d61096204f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:56.884391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ece06650-0628-4016-a368-85d61096204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:56.914600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:56.995083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece06650-0628-4016-a368-85d61096204f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:57.072579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cd4d3-c4e9-4ae5-8b74-324e2a49ff36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:57.073213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd4d3-c4e9-4ae5-8b74-324e2a49ff36 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:57.073497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd4d3-c4e9-4ae5-8b74-324e2a49ff36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:57.073772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd4d3-c4e9-4ae5-8b74-324e2a49ff36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:57.075470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-295cd4d3-c4e9-4ae5-8b74-324e2a49ff36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:57.152893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:57.185675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cd4d3-c4e9-4ae5-8b74-324e2a49ff36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:57.187108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cd4d3-c4e9-4ae5-8b74-324e2a49ff36 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:57.205595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 672/1331] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:28:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:28:59.517058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bdeca-2b81-4fe5-9579-8ecff3dc612f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:59.517579 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bdeca-2b81-4fe5-9579-8ecff3dc612f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:59.517700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bdeca-2b81-4fe5-9579-8ecff3dc612f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:59.519021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 660/1332] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:28:59.524342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf83edd-8244-426b-90f2-5e8516f30ebd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:59.524767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf83edd-8244-426b-90f2-5e8516f30ebd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:59.524907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf83edd-8244-426b-90f2-5e8516f30ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:59.592259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ddf83edd-8244-426b-90f2-5e8516f30ebd None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:59.593480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ddf83edd-8244-426b-90f2-5e8516f30ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:59.690873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 673/1333] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:28:59.728938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bdeca-2b81-4fe5-9579-8ecff3dc612f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:59.732094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e29bdeca-2b81-4fe5-9579-8ecff3dc612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:59.800997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:59.835160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bdeca-2b81-4fe5-9579-8ecff3dc612f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:59.905966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fa703-c280-4ed0-9eed-b52d479eea34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:59.906578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa703-c280-4ed0-9eed-b52d479eea34 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:59.906857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa703-c280-4ed0-9eed-b52d479eea34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:59.907129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa703-c280-4ed0-9eed-b52d479eea34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:59.908766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-214fa703-c280-4ed0-9eed-b52d479eea34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:00.013915 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fa703-c280-4ed0-9eed-b52d479eea34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:00.015343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fa703-c280-4ed0-9eed-b52d479eea34 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:00.025092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:00.033502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 661/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:02.093719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6005b-3d77-4305-8f4a-14fbc594c5b9 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:02.094275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6005b-3d77-4305-8f4a-14fbc594c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:02.094275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6005b-3d77-4305-8f4a-14fbc594c5b9 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:02.095705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 674/1335] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:02.101742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ff3ac-83d3-49e1-ae7d-3dd572542701 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:02.102221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ff3ac-83d3-49e1-ae7d-3dd572542701 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:02.102317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ff3ac-83d3-49e1-ae7d-3dd572542701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:02.168488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f98ff3ac-83d3-49e1-ae7d-3dd572542701 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:02.169966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f98ff3ac-83d3-49e1-ae7d-3dd572542701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:02.270581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 662/1336] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:02.311343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6005b-3d77-4305-8f4a-14fbc594c5b9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:02.312907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-dec6005b-3d77-4305-8f4a-14fbc594c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:02.353521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:02.416714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6005b-3d77-4305-8f4a-14fbc594c5b9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:02.489555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c3e71-beb7-4c6a-a87a-965127790b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:02.490167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c3e71-beb7-4c6a-a87a-965127790b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:02.490445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c3e71-beb7-4c6a-a87a-965127790b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:02.490714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c3e71-beb7-4c6a-a87a-965127790b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:02.492344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-154c3e71-beb7-4c6a-a87a-965127790b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:02.574888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:02.600657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c3e71-beb7-4c6a-a87a-965127790b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:02.602092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c3e71-beb7-4c6a-a87a-965127790b7e service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:02.619555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 675/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:05.030460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4627d-d710-44fe-a7ae-8bca8f0ac367 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:05.030992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4627d-d710-44fe-a7ae-8bca8f0ac367 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:05.030992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4627d-d710-44fe-a7ae-8bca8f0ac367 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:05.032414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 663/1338] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:05.037700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1866d-b534-40e5-84a5-9585fb91e44c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:05.038167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1866d-b534-40e5-84a5-9585fb91e44c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:05.038273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1866d-b534-40e5-84a5-9585fb91e44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:05.105964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-aee1866d-b534-40e5-84a5-9585fb91e44c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:05.107089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-aee1866d-b534-40e5-84a5-9585fb91e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:05.205818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 676/1339] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:29:05.242444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4627d-d710-44fe-a7ae-8bca8f0ac367 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:05.244050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f2b4627d-d710-44fe-a7ae-8bca8f0ac367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:05.322102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:05.349669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4627d-d710-44fe-a7ae-8bca8f0ac367 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:05.422873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e335e0-7f47-4fb1-aec3-b7a39f416b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:05.423441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e335e0-7f47-4fb1-aec3-b7a39f416b8e service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:05.423729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e335e0-7f47-4fb1-aec3-b7a39f416b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:05.424002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e335e0-7f47-4fb1-aec3-b7a39f416b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:05.427662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-65e335e0-7f47-4fb1-aec3-b7a39f416b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:05.539112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e335e0-7f47-4fb1-aec3-b7a39f416b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:05.540594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e335e0-7f47-4fb1-aec3-b7a39f416b8e service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:05.559168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 664/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:09.506490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7dde-df4f-4130-9c47-425c9d9bf2ce None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:09.507009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7dde-df4f-4130-9c47-425c9d9bf2ce None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:09.507101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7dde-df4f-4130-9c47-425c9d9bf2ce None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:09.508488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 677/1341] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:09.514023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc6cab-2d42-4a53-8ce0-3dd338f456bd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:09.514441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc6cab-2d42-4a53-8ce0-3dd338f456bd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:09.514574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc6cab-2d42-4a53-8ce0-3dd338f456bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:09.521454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:09.584983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-75bc6cab-2d42-4a53-8ce0-3dd338f456bd None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:09.586857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-75bc6cab-2d42-4a53-8ce0-3dd338f456bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:09.685618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 665/1342] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:09.724673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f7dde-df4f-4130-9c47-425c9d9bf2ce None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:09.726298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-869f7dde-df4f-4130-9c47-425c9d9bf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:09.776599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:09.833781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f7dde-df4f-4130-9c47-425c9d9bf2ce None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:09.908634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb067f3-8721-4d02-86f9-72e035fae35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:09.909294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb067f3-8721-4d02-86f9-72e035fae35d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:09.909575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb067f3-8721-4d02-86f9-72e035fae35d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:09.909850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb067f3-8721-4d02-86f9-72e035fae35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:09.911492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-eeb067f3-8721-4d02-86f9-72e035fae35d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:10.007442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:10.024797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb067f3-8721-4d02-86f9-72e035fae35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:10.026246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb067f3-8721-4d02-86f9-72e035fae35d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:10.046870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 678/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:12.688088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1857-cadf-4907-8cee-9414bd29a5f4 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:12.688654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1857-cadf-4907-8cee-9414bd29a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:12.688654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1857-cadf-4907-8cee-9414bd29a5f4 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:12.690068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 666/1344] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:29:12.695672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80463-fc99-4367-a16e-4e0006daeadd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:12.696218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80463-fc99-4367-a16e-4e0006daeadd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:12.696218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80463-fc99-4367-a16e-4e0006daeadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:12.772742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-baf80463-fc99-4367-a16e-4e0006daeadd None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:12.774057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-baf80463-fc99-4367-a16e-4e0006daeadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:12.879488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 679/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:12.916030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad1857-cadf-4907-8cee-9414bd29a5f4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:12.917602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3bad1857-cadf-4907-8cee-9414bd29a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:13.009592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:13.027388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad1857-cadf-4907-8cee-9414bd29a5f4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:13.104984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a205d-c2c5-49c2-b226-f84d05d599a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:13.105548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a205d-c2c5-49c2-b226-f84d05d599a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:13.105828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a205d-c2c5-49c2-b226-f84d05d599a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:13.106109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a205d-c2c5-49c2-b226-f84d05d599a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:13.107964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-861a205d-c2c5-49c2-b226-f84d05d599a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:13.217736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a205d-c2c5-49c2-b226-f84d05d599a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:13.219187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a205d-c2c5-49c2-b226-f84d05d599a1 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:13.239042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 667/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:17.330678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99366202-5e98-4018-bf2d-bc15b5752e96 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:17.331279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99366202-5e98-4018-bf2d-bc15b5752e96 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:17.331604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99366202-5e98-4018-bf2d-bc15b5752e96 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:17.333100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 680/1347] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:17.338557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891681d-3fcd-48a9-9b8d-4c91e30c08fe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:17.339023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891681d-3fcd-48a9-9b8d-4c91e30c08fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:17.339115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891681d-3fcd-48a9-9b8d-4c91e30c08fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:17.354136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:17.406996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b891681d-3fcd-48a9-9b8d-4c91e30c08fe None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:17.408248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b891681d-3fcd-48a9-9b8d-4c91e30c08fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:17.509024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 668/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:17.551258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99366202-5e98-4018-bf2d-bc15b5752e96 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:17.552881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-99366202-5e98-4018-bf2d-bc15b5752e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:17.612704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:17.671789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99366202-5e98-4018-bf2d-bc15b5752e96 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:17.761541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c17d1-8e5c-497d-a863-f30e43905be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:17.762184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c17d1-8e5c-497d-a863-f30e43905be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:17.762464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c17d1-8e5c-497d-a863-f30e43905be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:17.762735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c17d1-8e5c-497d-a863-f30e43905be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:17.764442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-641c17d1-8e5c-497d-a863-f30e43905be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:17.880829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:17.885409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c17d1-8e5c-497d-a863-f30e43905be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:17.886883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c17d1-8e5c-497d-a863-f30e43905be4 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:17.907123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 681/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:22.855648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037678e-f795-4980-bfef-e9b9cc689094 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:22.856543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037678e-f795-4980-bfef-e9b9cc689094 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:22.858735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037678e-f795-4980-bfef-e9b9cc689094 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:22.863410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 669/1350] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:29:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:22.866182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11873b8a-55c1-4a70-a0fc-a971f2e1b2d6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:22.866589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11873b8a-55c1-4a70-a0fc-a971f2e1b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:22.866840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11873b8a-55c1-4a70-a0fc-a971f2e1b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:23.010535 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-11873b8a-55c1-4a70-a0fc-a971f2e1b2d6 None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:23.012208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-11873b8a-55c1-4a70-a0fc-a971f2e1b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:23.132372 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 682/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:29:27.364525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac619-d64e-431e-9859-3461b9ba51fa None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:27.365064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac619-d64e-431e-9859-3461b9ba51fa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:27.365064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac619-d64e-431e-9859-3461b9ba51fa None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:27.366521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 670/1352] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:27.371939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410fee2-53bb-412d-bcee-5dd3a72944ca None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:27.372409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410fee2-53bb-412d-bcee-5dd3a72944ca None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:27.372710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410fee2-53bb-412d-bcee-5dd3a72944ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:27.442566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:27.469262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a410fee2-53bb-412d-bcee-5dd3a72944ca None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:27.471579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a410fee2-53bb-412d-bcee-5dd3a72944ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:27.507214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=59 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:27.592342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 683/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:28.841669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1452b-931c-498d-8f32-30fb664b44b6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:28.842221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1452b-931c-498d-8f32-30fb664b44b6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:28.842313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1452b-931c-498d-8f32-30fb664b44b6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:28.843721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 671/1354] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:28.849022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6cc19-e77e-4b3e-a046-ce287aac260b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:28.849453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6cc19-e77e-4b3e-a046-ce287aac260b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:28.849570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6cc19-e77e-4b3e-a046-ce287aac260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:28.929077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-09d6cc19-e77e-4b3e-a046-ce287aac260b None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:28.930287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-09d6cc19-e77e-4b3e-a046-ce287aac260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:28.973611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:29.040287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 684/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:29:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:32.537815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3203-6dbc-4635-9261-ba4ad6b53411 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:32.538367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3203-6dbc-4635-9261-ba4ad6b53411 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:32.538466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3203-6dbc-4635-9261-ba4ad6b53411 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:32.540085 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 672/1356] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:32.545358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fdcfe-08d6-459e-bce7-94fe9a869adb None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:32.545782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fdcfe-08d6-459e-bce7-94fe9a869adb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:32.546035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fdcfe-08d6-459e-bce7-94fe9a869adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:32.634865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-120fdcfe-08d6-459e-bce7-94fe9a869adb None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:32.636235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-120fdcfe-08d6-459e-bce7-94fe9a869adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:32.751658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 685/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:32.806699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109d82-75ca-471f-8ae0-f7aa23afe6f1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:32.808057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109d82-75ca-471f-8ae0-f7aa23afe6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:32.808815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109d82-75ca-471f-8ae0-f7aa23afe6f1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:32.811157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 673/1358] 10.222.0.71 () {54 vars in 962 bytes} [Mon Aug 1 15:29:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:32.824976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbf2e9-6a15-4252-8891-f2c1117273d3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:32.825266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbf2e9-6a15-4252-8891-f2c1117273d3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:32.825544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbf2e9-6a15-4252-8891-f2c1117273d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:32.844261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:32.909376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-afdbf2e9-6a15-4252-8891-f2c1117273d3 None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:32.910706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-afdbf2e9-6a15-4252-8891-f2c1117273d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:33.038056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 686/1359] 10.222.0.71 () {58 vars in 1059 bytes} [Mon Aug 1 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:33.046868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14109d82-75ca-471f-8ae0-f7aa23afe6f1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:33.048621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14109d82-75ca-471f-8ae0-f7aa23afe6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:33.232847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14109d82-75ca-471f-8ae0-f7aa23afe6f1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:33.315797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:33.363543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e30c85-7df9-4362-b86c-598bee9101d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:33.364172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30c85-7df9-4362-b86c-598bee9101d2 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:33.364455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30c85-7df9-4362-b86c-598bee9101d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:33.364730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30c85-7df9-4362-b86c-598bee9101d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:33.366646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-59e30c85-7df9-4362-b86c-598bee9101d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:33.466058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e30c85-7df9-4362-b86c-598bee9101d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:33.467726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e30c85-7df9-4362-b86c-598bee9101d2 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:33.487904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 674/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:35.754992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1db2cc-6c2b-4ead-8f3a-365591054d74 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:35.755525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1db2cc-6c2b-4ead-8f3a-365591054d74 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:35.755632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1db2cc-6c2b-4ead-8f3a-365591054d74 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:35.760759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 687/1361] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:35.765107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b50e5-560d-49f2-844b-86b7d8e9e814 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:35.765548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b50e5-560d-49f2-844b-86b7d8e9e814 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:35.765921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b50e5-560d-49f2-844b-86b7d8e9e814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:35.846536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bd3b50e5-560d-49f2-844b-86b7d8e9e814 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:35.847898 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bd3b50e5-560d-49f2-844b-86b7d8e9e814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:35.889921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:35.955353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 675/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:36.002014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1db2cc-6c2b-4ead-8f3a-365591054d74 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:36.003654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bb1db2cc-6c2b-4ead-8f3a-365591054d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:36.079821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:36.182924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1db2cc-6c2b-4ead-8f3a-365591054d74 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:36.315312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c74614-f841-434e-85e7-ef0e1217e525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:36.316094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74614-f841-434e-85e7-ef0e1217e525 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:36.316408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74614-f841-434e-85e7-ef0e1217e525 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:36.316729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74614-f841-434e-85e7-ef0e1217e525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:36.318413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f2c74614-f841-434e-85e7-ef0e1217e525 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:36.344392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:36.421996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c74614-f841-434e-85e7-ef0e1217e525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:36.424571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c74614-f841-434e-85e7-ef0e1217e525 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:36.444706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 688/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:38.834125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6d49-210a-4227-9c71-200f27c4d7cf None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:38.834776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6d49-210a-4227-9c71-200f27c4d7cf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:38.834776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6d49-210a-4227-9c71-200f27c4d7cf None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:38.836008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 676/1364] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:38.841939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d313bf-5548-4390-86f9-4977c347bc07 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:38.842538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d313bf-5548-4390-86f9-4977c347bc07 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:38.842787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d313bf-5548-4390-86f9-4977c347bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:38.924245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-41d313bf-5548-4390-86f9-4977c347bc07 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:38.925478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-41d313bf-5548-4390-86f9-4977c347bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:39.071317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:39.075438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 689/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:29:39.129932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a913-654f-419a-9378-43e14f7fe648 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:39.130565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a913-654f-419a-9378-43e14f7fe648 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:39.131068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a913-654f-419a-9378-43e14f7fe648 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:39.132633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 677/1366] 10.222.0.71 () {54 vars in 962 bytes} [Mon Aug 1 15:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:39.138843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cbfdc-dbf2-4527-9c22-55adffd96e9c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:39.139144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cbfdc-dbf2-4527-9c22-55adffd96e9c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:39.139459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cbfdc-dbf2-4527-9c22-55adffd96e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:39.240368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9b5cbfdc-dbf2-4527-9c22-55adffd96e9c None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:39.241588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9b5cbfdc-dbf2-4527-9c22-55adffd96e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:39.382326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 690/1367] 10.222.0.71 () {58 vars in 1059 bytes} [Mon Aug 1 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:39.391881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53a913-654f-419a-9378-43e14f7fe648 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:39.393522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c53a913-654f-419a-9378-43e14f7fe648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:39.555883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53a913-654f-419a-9378-43e14f7fe648 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:39.578682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:39.684257 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79974a5b-8d18-459a-b5b1-f303fa1a462d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:39.684799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974a5b-8d18-459a-b5b1-f303fa1a462d service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:39.685078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974a5b-8d18-459a-b5b1-f303fa1a462d service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:39.685348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974a5b-8d18-459a-b5b1-f303fa1a462d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:39.686967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-79974a5b-8d18-459a-b5b1-f303fa1a462d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:39.786915 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79974a5b-8d18-459a-b5b1-f303fa1a462d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:39.788563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79974a5b-8d18-459a-b5b1-f303fa1a462d service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:39.808443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 678/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:40.958277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410e0f-e3c0-4cef-aa74-4c228e22330f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:40.958785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410e0f-e3c0-4cef-aa74-4c228e22330f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:40.958785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410e0f-e3c0-4cef-aa74-4c228e22330f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:40.960422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 691/1369] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:40.966230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5368d9-5f96-415e-8220-31ff9a33003e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:40.966700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5368d9-5f96-415e-8220-31ff9a33003e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:40.966700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5368d9-5f96-415e-8220-31ff9a33003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:41.004949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:41.051064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8b5368d9-5f96-415e-8220-31ff9a33003e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:41.052344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8b5368d9-5f96-415e-8220-31ff9a33003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:41.186313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 679/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:41.540244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a82ee-1806-4a28-8354-131ab59b281f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:41.540244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a82ee-1806-4a28-8354-131ab59b281f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:41.540244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a82ee-1806-4a28-8354-131ab59b281f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:41.544395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 692/1371] 10.222.0.71 () {54 vars in 964 bytes} [Mon Aug 1 15:29:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:41.550422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3d86-0175-4b33-ae43-f5ba1ca379eb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:41.551295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3d86-0175-4b33-ae43-f5ba1ca379eb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:41.551295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3d86-0175-4b33-ae43-f5ba1ca379eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:41.643865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-203e3d86-0175-4b33-ae43-f5ba1ca379eb None None] MFA Rules not processed for user `79a4e12e752446f296569df09f2ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:41.645240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-203e3d86-0175-4b33-ae43-f5ba1ca379eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:41.697632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:41.729070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 680/1372] 10.222.0.71 () {58 vars in 1061 bytes} [Mon Aug 1 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:41.738912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a82ee-1806-4a28-8354-131ab59b281f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:41.740724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d60a82ee-1806-4a28-8354-131ab59b281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:41.793739 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:41.851585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a82ee-1806-4a28-8354-131ab59b281f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:41.935252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:41.936065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:41.936350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:41.936622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:41.938257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:41.988301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7df10-5f27-4bd4-a613-482597183c09 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:41.988810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7df10-5f27-4bd4-a613-482597183c09 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:41.988914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7df10-5f27-4bd4-a613-482597183c09 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:41.991475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 681/1373] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:41.996485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa65b6-bc8d-4d07-a7c7-6dce53222210 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:41.996983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa65b6-bc8d-4d07-a7c7-6dce53222210 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:41.997269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa65b6-bc8d-4d07-a7c7-6dce53222210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:42.055758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:42.077831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:42.079675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:42.084617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1caa65b6-bc8d-4d07-a7c7-6dce53222210 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:42.085834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1caa65b6-bc8d-4d07-a7c7-6dce53222210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:42.101814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 693/1374] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:42.203953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 682/1375] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:42.244389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:42.245899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:42.353966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9126c-41aa-41d3-88e3-9fd12ed5280c service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:42.476081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:42.488034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a59ae-eb6d-492f-9d5e-e4e4a19f5825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:42.488655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a59ae-eb6d-492f-9d5e-e4e4a19f5825 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:42.488934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a59ae-eb6d-492f-9d5e-e4e4a19f5825 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:42.489210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a59ae-eb6d-492f-9d5e-e4e4a19f5825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:42.490825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4e6a59ae-eb6d-492f-9d5e-e4e4a19f5825 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:42.582085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a59ae-eb6d-492f-9d5e-e4e4a19f5825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:42.583652 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a59ae-eb6d-492f-9d5e-e4e4a19f5825 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:42.602164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 694/1376] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:44.634828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cc661-9440-4a77-b1b0-8dd6f8eb713b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:44.635294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cc661-9440-4a77-b1b0-8dd6f8eb713b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:44.635420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cc661-9440-4a77-b1b0-8dd6f8eb713b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:44.637057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 683/1377] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:44.643398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7f7d-5584-4c7d-a190-b8d162b70e2f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:44.643820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7f7d-5584-4c7d-a190-b8d162b70e2f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:44.643999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7f7d-5584-4c7d-a190-b8d162b70e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:44.733189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-67eb7f7d-5584-4c7d-a190-b8d162b70e2f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:44.734417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-67eb7f7d-5584-4c7d-a190-b8d162b70e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:44.798946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:44.838017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 695/1378] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:44.883715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cc661-9440-4a77-b1b0-8dd6f8eb713b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:44.885332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7d5cc661-9440-4a77-b1b0-8dd6f8eb713b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:44.937578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:45.038699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cc661-9440-4a77-b1b0-8dd6f8eb713b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:45.175448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f63af-8e3c-4145-b60f-5af29d4942b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:45.176020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f63af-8e3c-4145-b60f-5af29d4942b2 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:45.176305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f63af-8e3c-4145-b60f-5af29d4942b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:45.176580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f63af-8e3c-4145-b60f-5af29d4942b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:45.178264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-183f63af-8e3c-4145-b60f-5af29d4942b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:45.193017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:45.276921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f63af-8e3c-4145-b60f-5af29d4942b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:45.278588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f63af-8e3c-4145-b60f-5af29d4942b2 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:45.297142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 684/1379] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:47.365441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09d2a-7431-49b0-bb79-b1670262547e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:47.365993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09d2a-7431-49b0-bb79-b1670262547e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:47.365993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09d2a-7431-49b0-bb79-b1670262547e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:47.367539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 696/1380] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:47.372883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3c145-ba33-4d95-a336-17fa7a1d2ef8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:47.373321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3c145-ba33-4d95-a336-17fa7a1d2ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:47.373432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3c145-ba33-4d95-a336-17fa7a1d2ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:47.444524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-24a3c145-ba33-4d95-a336-17fa7a1d2ef8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:47.445750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-24a3c145-ba33-4d95-a336-17fa7a1d2ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:47.542469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:47.556559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 685/1381] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:47.601732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c09d2a-7431-49b0-bb79-b1670262547e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:47.603247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-02c09d2a-7431-49b0-bb79-b1670262547e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:47.776780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c09d2a-7431-49b0-bb79-b1670262547e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:47.830885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:47.901919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a4e44-9d0f-4f49-8eaa-14ba36e78eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:47.902543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a4e44-9d0f-4f49-8eaa-14ba36e78eea service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:47.902823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a4e44-9d0f-4f49-8eaa-14ba36e78eea service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:47.903093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a4e44-9d0f-4f49-8eaa-14ba36e78eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:47.905170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-805a4e44-9d0f-4f49-8eaa-14ba36e78eea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:48.005032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a4e44-9d0f-4f49-8eaa-14ba36e78eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:48.007064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a4e44-9d0f-4f49-8eaa-14ba36e78eea service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:48.040082 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 697/1382] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:50.217772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f947c6-0e96-402b-aab0-904b4d2ba6b7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:50.218362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f947c6-0e96-402b-aab0-904b4d2ba6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:50.218462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f947c6-0e96-402b-aab0-904b4d2ba6b7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:50.220950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 686/1383] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:50.226503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e412c-a0e2-4a24-b619-5e886d56e9b6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:50.226931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e412c-a0e2-4a24-b619-5e886d56e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:50.227074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e412c-a0e2-4a24-b619-5e886d56e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:50.300624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9f5e412c-a0e2-4a24-b619-5e886d56e9b6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:50.301956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9f5e412c-a0e2-4a24-b619-5e886d56e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:50.304263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:50.415093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 698/1384] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:50.467760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f947c6-0e96-402b-aab0-904b4d2ba6b7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:50.470371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-99f947c6-0e96-402b-aab0-904b4d2ba6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:50.683639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f947c6-0e96-402b-aab0-904b4d2ba6b7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:50.764251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:50.824820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff9f7b-473a-41b7-9b41-57c99d56a23c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:50.825448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff9f7b-473a-41b7-9b41-57c99d56a23c service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:50.825732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff9f7b-473a-41b7-9b41-57c99d56a23c service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:50.826010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff9f7b-473a-41b7-9b41-57c99d56a23c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:50.827683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-89ff9f7b-473a-41b7-9b41-57c99d56a23c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:50.958980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff9f7b-473a-41b7-9b41-57c99d56a23c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:50.960644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff9f7b-473a-41b7-9b41-57c99d56a23c service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:50.979866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 687/1385] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:53.020626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04c46b-5861-48ff-9415-9b87f8025846 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:53.021531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04c46b-5861-48ff-9415-9b87f8025846 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:53.021531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04c46b-5861-48ff-9415-9b87f8025846 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:53.022531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 699/1386] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:53.028509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230270-6e0f-4102-a208-92abd6d3e126 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:53.029298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230270-6e0f-4102-a208-92abd6d3e126 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:53.029298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230270-6e0f-4102-a208-92abd6d3e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:53.114560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0d230270-6e0f-4102-a208-92abd6d3e126 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:53.115743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0d230270-6e0f-4102-a208-92abd6d3e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:53.145952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:53.264446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 688/1387] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:29:53.315159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04c46b-5861-48ff-9415-9b87f8025846 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:53.316800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6c04c46b-5861-48ff-9415-9b87f8025846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:53.489418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:53.507764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04c46b-5861-48ff-9415-9b87f8025846 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:53.650158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f09c2-1c8d-40c9-83fa-55d6c8de3b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:53.650818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f09c2-1c8d-40c9-83fa-55d6c8de3b2d service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:53.651104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f09c2-1c8d-40c9-83fa-55d6c8de3b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:53.651462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f09c2-1c8d-40c9-83fa-55d6c8de3b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:53.653114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e12f09c2-1c8d-40c9-83fa-55d6c8de3b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:53.762345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f09c2-1c8d-40c9-83fa-55d6c8de3b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:53.764143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f09c2-1c8d-40c9-83fa-55d6c8de3b2d service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:53.770571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:53.787327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 700/1388] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:55.932427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014501-be62-4cdb-85ba-5b5162ca4b6b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:55.932996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014501-be62-4cdb-85ba-5b5162ca4b6b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:55.932996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014501-be62-4cdb-85ba-5b5162ca4b6b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:55.934319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 689/1389] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:29:55.939836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ccae-c177-47e1-b1b9-bb84b236d63e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:55.940269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ccae-c177-47e1-b1b9-bb84b236d63e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:55.940385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ccae-c177-47e1-b1b9-bb84b236d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:56.014716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7fc3ccae-c177-47e1-b1b9-bb84b236d63e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:56.016768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7fc3ccae-c177-47e1-b1b9-bb84b236d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:56.165852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 701/1390] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:56.215441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf014501-be62-4cdb-85ba-5b5162ca4b6b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:56.217028 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bf014501-be62-4cdb-85ba-5b5162ca4b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:56.391241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf014501-be62-4cdb-85ba-5b5162ca4b6b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:56.402981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:56.530685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc68f2a-49ca-42a5-9f0a-7885e7d18a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:56.531308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68f2a-49ca-42a5-9f0a-7885e7d18a68 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:56.531619 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68f2a-49ca-42a5-9f0a-7885e7d18a68 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:56.531891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68f2a-49ca-42a5-9f0a-7885e7d18a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:56.533673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-efc68f2a-49ca-42a5-9f0a-7885e7d18a68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:56.624031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc68f2a-49ca-42a5-9f0a-7885e7d18a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:56.627510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc68f2a-49ca-42a5-9f0a-7885e7d18a68 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:56.651714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 690/1391] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:29:57.359227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88390567-e407-4858-afd4-378f79b3aec2 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:57.360045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88390567-e407-4858-afd4-378f79b3aec2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:57.360045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88390567-e407-4858-afd4-378f79b3aec2 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:57.362279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 702/1392] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:57.367781 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c4e6-45f5-41a3-86cc-1495855bbcd8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:57.368210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c4e6-45f5-41a3-86cc-1495855bbcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:57.368352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c4e6-45f5-41a3-86cc-1495855bbcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:57.384082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:57.438154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c849c4e6-45f5-41a3-86cc-1495855bbcd8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:57.439467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c849c4e6-45f5-41a3-86cc-1495855bbcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:57.546783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 691/1393] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:57.609067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f19ec-7118-40dd-9d38-46ea31d62ca2 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:57.609348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f19ec-7118-40dd-9d38-46ea31d62ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:57.609627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f19ec-7118-40dd-9d38-46ea31d62ca2 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:57.611501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 703/1394] 10.222.0.71 () {54 vars in 966 bytes} [Mon Aug 1 15:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:29:57.616990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8df6-9b44-409a-8db8-901247882a96 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:57.617279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8df6-9b44-409a-8db8-901247882a96 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:57.617553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8df6-9b44-409a-8db8-901247882a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:57.702840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d7ba8df6-9b44-409a-8db8-901247882a96 None None] MFA Rules not processed for user `f03250eb151044619c0f720f315b8509`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:57.704267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d7ba8df6-9b44-409a-8db8-901247882a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:57.740810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:57.797767 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 692/1395] 10.222.0.71 () {58 vars in 1063 bytes} [Mon Aug 1 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:57.806487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f19ec-7118-40dd-9d38-46ea31d62ca2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:57.808317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ec0f19ec-7118-40dd-9d38-46ea31d62ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:57.891622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:57.924796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f19ec-7118-40dd-9d38-46ea31d62ca2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:58.007571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff72b21-8971-40b0-9ab1-aedce7a861b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03250eb151044619c0f720f315b8509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:58.008201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72b21-8971-40b0-9ab1-aedce7a861b7 service glance] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:58.008477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72b21-8971-40b0-9ab1-aedce7a861b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:58.008749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72b21-8971-40b0-9ab1-aedce7a861b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:58.010392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bff72b21-8971-40b0-9ab1-aedce7a861b7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:58.141043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff72b21-8971-40b0-9ab1-aedce7a861b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:58.142437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff72b21-8971-40b0-9ab1-aedce7a861b7 service glance] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:58.170861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:58.176608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 704/1396] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:29:58.715871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4925c-030e-47ee-99f2-31e89c1e6345 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:58.716675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4925c-030e-47ee-99f2-31e89c1e6345 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:58.716675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4925c-030e-47ee-99f2-31e89c1e6345 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:58.719457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 693/1397] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:29:58.726819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae310f0-03d0-4634-898e-e599bc14dfca None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:58.727364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae310f0-03d0-4634-898e-e599bc14dfca None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:58.727364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae310f0-03d0-4634-898e-e599bc14dfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:58.835885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3ae310f0-03d0-4634-898e-e599bc14dfca None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:58.837999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3ae310f0-03d0-4634-898e-e599bc14dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:58.983498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 705/1398] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:59.013869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe88b4-8525-49b6-bb60-d84df626e991 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:59.014552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe88b4-8525-49b6-bb60-d84df626e991 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:59.014552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe88b4-8525-49b6-bb60-d84df626e991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:59.027390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae310f0-03d0-4634-898e-e599bc14dfca None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:59.028617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3ae310f0-03d0-4634-898e-e599bc14dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:59.093773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cffe88b4-8525-49b6-bb60-d84df626e991 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:59.095092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cffe88b4-8525-49b6-bb60-d84df626e991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:59.114058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.179955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae310f0-03d0-4634-898e-e599bc14dfca None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:59.214514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 694/1399] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:59.264121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459e6ae-5d89-4ad0-8cd0-6a9fa111e4d0 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:59.264408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459e6ae-5d89-4ad0-8cd0-6a9fa111e4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:59.264693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459e6ae-5d89-4ad0-8cd0-6a9fa111e4d0 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:59.266056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 695/1400] 10.222.0.71 () {54 vars in 943 bytes} [Mon Aug 1 15:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:29:59.272922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576e55-2ae8-45b7-a3ec-89fd51e1deda None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:59.273206 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576e55-2ae8-45b7-a3ec-89fd51e1deda None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:59.273568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576e55-2ae8-45b7-a3ec-89fd51e1deda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:59.330199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:59.330829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:59.331102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:59.331406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:59.333081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:59.339511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.364505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-20576e55-2ae8-45b7-a3ec-89fd51e1deda None None] MFA Rules not processed for user `f2434616a540474f948c821e18e1a112`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:59.366239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-20576e55-2ae8-45b7-a3ec-89fd51e1deda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:59.417153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.434525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:59.436202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:59.456421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 706/1401] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:29:59.497112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 696/1402] 10.222.0.71 () {58 vars in 1040 bytes} [Mon Aug 1 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:29:59.506827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:59.508060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:59.620260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444794a4-49a3-442b-9455-db6a1d2c9056 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:59.743516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc171-1ded-4f58-acbc-94e669e49031 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:59.744263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc171-1ded-4f58-acbc-94e669e49031 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:59.745629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc171-1ded-4f58-acbc-94e669e49031 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:59.745629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc171-1ded-4f58-acbc-94e669e49031 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:59.747013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e27fc171-1ded-4f58-acbc-94e669e49031 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:59.756310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.838835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fc171-1ded-4f58-acbc-94e669e49031 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:59.840549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fc171-1ded-4f58-acbc-94e669e49031 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:59.849023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 707/1403] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:30:01.554823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09955cc-0f1a-42d2-ad4b-1e761c01d4e2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:01.555481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09955cc-0f1a-42d2-ad4b-1e761c01d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:01.555481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09955cc-0f1a-42d2-ad4b-1e761c01d4e2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:01.557057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 697/1404] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:01.562640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1cbf7-125a-49ff-bec9-881ea4a365b1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:01.563163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1cbf7-125a-49ff-bec9-881ea4a365b1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:01.563244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1cbf7-125a-49ff-bec9-881ea4a365b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:01.648744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4ee1cbf7-125a-49ff-bec9-881ea4a365b1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:01.649995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4ee1cbf7-125a-49ff-bec9-881ea4a365b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:01.775248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:01.784327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 708/1405] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:01.823828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09955cc-0f1a-42d2-ad4b-1e761c01d4e2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:01.825382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d09955cc-0f1a-42d2-ad4b-1e761c01d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:01.968873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:02.036537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09955cc-0f1a-42d2-ad4b-1e761c01d4e2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:02.185902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76386-8ace-4f3b-9932-8e9d04c6bf16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:02.186458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76386-8ace-4f3b-9932-8e9d04c6bf16 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:02.186737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76386-8ace-4f3b-9932-8e9d04c6bf16 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:02.187015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76386-8ace-4f3b-9932-8e9d04c6bf16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:02.189261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-30a76386-8ace-4f3b-9932-8e9d04c6bf16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:02.286223 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:02.308410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a76386-8ace-4f3b-9932-8e9d04c6bf16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:02.310466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a76386-8ace-4f3b-9932-8e9d04c6bf16 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:02.330517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 698/1406] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:04.610310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8a09-654a-4774-8eb2-7bef6e2d0fa4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:04.611463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8a09-654a-4774-8eb2-7bef6e2d0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:04.611463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8a09-654a-4774-8eb2-7bef6e2d0fa4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:04.612959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 709/1407] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:04.619200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859b4c-8fd4-437c-ae68-c0913dd8741e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:04.619200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859b4c-8fd4-437c-ae68-c0913dd8741e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:04.619200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859b4c-8fd4-437c-ae68-c0913dd8741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:04.706954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-45859b4c-8fd4-437c-ae68-c0913dd8741e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:04.708582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-45859b4c-8fd4-437c-ae68-c0913dd8741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:04.836706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 699/1408] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:30:04.887721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e8a09-654a-4774-8eb2-7bef6e2d0fa4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:04.889786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3d2e8a09-654a-4774-8eb2-7bef6e2d0fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:05.124956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e8a09-654a-4774-8eb2-7bef6e2d0fa4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:05.347718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:05.410110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a269bd6-8c7e-47fb-ba0d-14aa07b83cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:05.410687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269bd6-8c7e-47fb-ba0d-14aa07b83cbc service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:05.410969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269bd6-8c7e-47fb-ba0d-14aa07b83cbc service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:05.411239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269bd6-8c7e-47fb-ba0d-14aa07b83cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:05.412977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4a269bd6-8c7e-47fb-ba0d-14aa07b83cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:05.531757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a269bd6-8c7e-47fb-ba0d-14aa07b83cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:05.533717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a269bd6-8c7e-47fb-ba0d-14aa07b83cbc service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:05.554474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 710/1409] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:30:14.834865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=79 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:15.552239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=62 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:22.916436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128cecc-9eb5-4d2d-8cce-afe7a78effc0 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:22.917171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128cecc-9eb5-4d2d-8cce-afe7a78effc0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:22.917171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128cecc-9eb5-4d2d-8cce-afe7a78effc0 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:22.918414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 700/1410] 10.222.0.71 () {54 vars in 918 bytes} [Mon Aug 1 15:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:22.924871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4af767-78ff-4053-882e-465fde3af520 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:22.925374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4af767-78ff-4053-882e-465fde3af520 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:22.925477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4af767-78ff-4053-882e-465fde3af520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:23.005866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9c4af767-78ff-4053-882e-465fde3af520 None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:23.007094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9c4af767-78ff-4053-882e-465fde3af520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:23.127791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 711/1411] 10.222.0.71 () {58 vars in 1015 bytes} [Mon Aug 1 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:23.143104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2ed0-c7b9-4971-9971-e7a0b5b664e6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:23.143416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2ed0-c7b9-4971-9971-e7a0b5b664e6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:23.143704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2ed0-c7b9-4971-9971-e7a0b5b664e6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:23.145081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 701/1412] 10.222.0.71 () {54 vars in 918 bytes} [Mon Aug 1 15:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:23.150202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb18de-124c-445b-b712-276750b53b01 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:23.150497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb18de-124c-445b-b712-276750b53b01 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:23.150775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb18de-124c-445b-b712-276750b53b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:23.238235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:23.241349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-67eb18de-124c-445b-b712-276750b53b01 None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:23.245637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-67eb18de-124c-445b-b712-276750b53b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:23.387826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 712/1413] 10.222.0.71 () {58 vars in 1015 bytes} [Mon Aug 1 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:26.035403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01501f63-9155-4f54-94c1-9c2307795c82 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:26.036232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01501f63-9155-4f54-94c1-9c2307795c82 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:26.036232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01501f63-9155-4f54-94c1-9c2307795c82 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:26.037283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:30:26.047750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a256d41-2a5b-4240-b082-c72e1fdc39e2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:26.048551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a256d41-2a5b-4240-b082-c72e1fdc39e2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:26.048551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a256d41-2a5b-4240-b082-c72e1fdc39e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:26.158002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8a256d41-2a5b-4240-b082-c72e1fdc39e2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:26.159980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8a256d41-2a5b-4240-b082-c72e1fdc39e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:26.254605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:26.324218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:26.384360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01501f63-9155-4f54-94c1-9c2307795c82 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:26.385999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-01501f63-9155-4f54-94c1-9c2307795c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:26.721929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01501f63-9155-4f54-94c1-9c2307795c82 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:26.806088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:26.856959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d6ac9-142b-4312-86e8-fe19a198d7e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:26.857609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d6ac9-142b-4312-86e8-fe19a198d7e1 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:26.857891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d6ac9-142b-4312-86e8-fe19a198d7e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:26.858170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d6ac9-142b-4312-86e8-fe19a198d7e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:26.859838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da0d6ac9-142b-4312-86e8-fe19a198d7e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:26.952593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d6ac9-142b-4312-86e8-fe19a198d7e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:26.954760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d6ac9-142b-4312-86e8-fe19a198d7e1 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:26.979531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 703/1416] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:27.930606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba845-ef67-4eed-b83e-5a3d14245487 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:27.931178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba845-ef67-4eed-b83e-5a3d14245487 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:27.931178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba845-ef67-4eed-b83e-5a3d14245487 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:27.932550 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:27.937836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec984-7b41-4bcf-b9e4-be55b29abe21 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:27.938876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec984-7b41-4bcf-b9e4-be55b29abe21 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:27.938985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec984-7b41-4bcf-b9e4-be55b29abe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:28.026536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ac1ec984-7b41-4bcf-b9e4-be55b29abe21 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:28.027844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ac1ec984-7b41-4bcf-b9e4-be55b29abe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:28.067020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:28.142428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:28.300564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba845-ef67-4eed-b83e-5a3d14245487 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:28.302081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0d1ba845-ef67-4eed-b83e-5a3d14245487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:28.460224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba845-ef67-4eed-b83e-5a3d14245487 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:28.502066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:28.591763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4e3b-e9df-4486-ab57-b59d3862d800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:28.592389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4e3b-e9df-4486-ab57-b59d3862d800 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:28.592670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4e3b-e9df-4486-ab57-b59d3862d800 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:28.593008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4e3b-e9df-4486-ab57-b59d3862d800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:28.595270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-298b4e3b-e9df-4486-ab57-b59d3862d800 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:28.706760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4e3b-e9df-4486-ab57-b59d3862d800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:28.708447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4e3b-e9df-4486-ab57-b59d3862d800 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:28.730235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 715/1419] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:29.684186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5460c1-5a87-4ad9-b762-b6ea6ab0a51d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:29.684757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5460c1-5a87-4ad9-b762-b6ea6ab0a51d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:29.685472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5460c1-5a87-4ad9-b762-b6ea6ab0a51d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:29.686429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:29.698562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703821f-9234-4d50-9e70-3a03f5904226 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:29.698562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703821f-9234-4d50-9e70-3a03f5904226 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:29.698562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703821f-9234-4d50-9e70-3a03f5904226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:29.755473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:29.780248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1703821f-9234-4d50-9e70-3a03f5904226 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:29.781479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1703821f-9234-4d50-9e70-3a03f5904226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:29.896014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:30.050068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5460c1-5a87-4ad9-b762-b6ea6ab0a51d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:30.051697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6d5460c1-5a87-4ad9-b762-b6ea6ab0a51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:30.205605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5460c1-5a87-4ad9-b762-b6ea6ab0a51d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:30.218498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:30.330605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef836101-c6b2-4588-a2c5-e0e6ac0ac72d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:30.331144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef836101-c6b2-4588-a2c5-e0e6ac0ac72d service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:30.331460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef836101-c6b2-4588-a2c5-e0e6ac0ac72d service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:30.331795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef836101-c6b2-4588-a2c5-e0e6ac0ac72d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:30.333486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ef836101-c6b2-4588-a2c5-e0e6ac0ac72d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:30.432934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef836101-c6b2-4588-a2c5-e0e6ac0ac72d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:30.434537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef836101-c6b2-4588-a2c5-e0e6ac0ac72d service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:30.453098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 706/1422] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:31.334464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f6faa-e858-4145-a59c-2ec77f25e873 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:31.335107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f6faa-e858-4145-a59c-2ec77f25e873 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:31.335107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f6faa-e858-4145-a59c-2ec77f25e873 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:31.336539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:31.341924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991b1c-050d-420c-8a95-388700bd1bc1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:31.342400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991b1c-050d-420c-8a95-388700bd1bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:31.342523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991b1c-050d-420c-8a95-388700bd1bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:31.365673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:31.424109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-52991b1c-050d-420c-8a95-388700bd1bc1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:31.425331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-52991b1c-050d-420c-8a95-388700bd1bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:31.532866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:31.693851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f6faa-e858-4145-a59c-2ec77f25e873 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:31.695450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-406f6faa-e858-4145-a59c-2ec77f25e873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:31.850157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:31.893728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f6faa-e858-4145-a59c-2ec77f25e873 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:32.034327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb3678-9a1a-411a-b06d-3e29ca6e3da8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:32.034957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb3678-9a1a-411a-b06d-3e29ca6e3da8 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:32.035237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb3678-9a1a-411a-b06d-3e29ca6e3da8 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:32.036687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb3678-9a1a-411a-b06d-3e29ca6e3da8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:32.038080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6aeb3678-9a1a-411a-b06d-3e29ca6e3da8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:32.135605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:32.151582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb3678-9a1a-411a-b06d-3e29ca6e3da8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:32.153810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb3678-9a1a-411a-b06d-3e29ca6e3da8 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:32.174609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 718/1425] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:33.065407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59c397-1b32-4c6f-b4e1-fec917b538e7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:33.066128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59c397-1b32-4c6f-b4e1-fec917b538e7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:33.066128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59c397-1b32-4c6f-b4e1-fec917b538e7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:33.067322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:33.076334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7627fc-3682-4fc1-8219-43da1ca4a182 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:33.076992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7627fc-3682-4fc1-8219-43da1ca4a182 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:33.076992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7627fc-3682-4fc1-8219-43da1ca4a182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:33.187494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2e7627fc-3682-4fc1-8219-43da1ca4a182 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:33.189308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2e7627fc-3682-4fc1-8219-43da1ca4a182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:33.295790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:33.447489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59c397-1b32-4c6f-b4e1-fec917b538e7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:33.448990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1e59c397-1b32-4c6f-b4e1-fec917b538e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:33.540096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:33.611329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59c397-1b32-4c6f-b4e1-fec917b538e7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:33.736033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c3ca6-3477-461a-aa06-024d565798b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:33.736695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3ca6-3477-461a-aa06-024d565798b1 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:33.736976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3ca6-3477-461a-aa06-024d565798b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:33.737251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3ca6-3477-461a-aa06-024d565798b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:33.738915 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9d5c3ca6-3477-461a-aa06-024d565798b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:33.794621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:33.841589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c3ca6-3477-461a-aa06-024d565798b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:33.843222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c3ca6-3477-461a-aa06-024d565798b1 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:33.861768 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 709/1428] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:34.690108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0ae5-d9b5-40be-8915-a710527fbe99 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:34.690677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0ae5-d9b5-40be-8915-a710527fbe99 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:34.690793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0ae5-d9b5-40be-8915-a710527fbe99 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:34.692125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:34.697480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79ef93-17a2-47a8-9241-1f970de3db12 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:34.697979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79ef93-17a2-47a8-9241-1f970de3db12 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:34.698140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79ef93-17a2-47a8-9241-1f970de3db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:34.780014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0b79ef93-17a2-47a8-9241-1f970de3db12 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:34.781158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0b79ef93-17a2-47a8-9241-1f970de3db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:34.880099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:35.033534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd0ae5-d9b5-40be-8915-a710527fbe99 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:35.035007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5ccd0ae5-d9b5-40be-8915-a710527fbe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:35.086338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:35.188189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd0ae5-d9b5-40be-8915-a710527fbe99 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:35.307327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2a8fa-66cc-49d2-9283-b0163c34c3f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:35.307896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2a8fa-66cc-49d2-9283-b0163c34c3f1 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:35.308174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2a8fa-66cc-49d2-9283-b0163c34c3f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:35.308448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2a8fa-66cc-49d2-9283-b0163c34c3f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:35.310078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-39a2a8fa-66cc-49d2-9283-b0163c34c3f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:35.317457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:35.413205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2a8fa-66cc-49d2-9283-b0163c34c3f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:35.414806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2a8fa-66cc-49d2-9283-b0163c34c3f1 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:35.434671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 721/1431] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:36.253365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1df8b-8952-40fe-bb22-34cae81321e1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:36.253815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1df8b-8952-40fe-bb22-34cae81321e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:36.254131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1df8b-8952-40fe-bb22-34cae81321e1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:36.256240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:30:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:36.261371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8d9ae-732b-43d0-a186-97f112249579 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:36.261820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8d9ae-732b-43d0-a186-97f112249579 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:36.261915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8d9ae-732b-43d0-a186-97f112249579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:36.339341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-13d8d9ae-732b-43d0-a186-97f112249579 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:36.340599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-13d8d9ae-732b-43d0-a186-97f112249579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:36.417095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:36.455470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:36.612432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1df8b-8952-40fe-bb22-34cae81321e1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:36.615062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-15a1df8b-8952-40fe-bb22-34cae81321e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:36.639633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:36.782859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1df8b-8952-40fe-bb22-34cae81321e1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:36.875316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:36.915976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bd84b-68d4-4037-8d8d-c06dc60841fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:36.916615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd84b-68d4-4037-8d8d-c06dc60841fb service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:36.916896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd84b-68d4-4037-8d8d-c06dc60841fb service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:36.917178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd84b-68d4-4037-8d8d-c06dc60841fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:36.918914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-981bd84b-68d4-4037-8d8d-c06dc60841fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:37.024535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bd84b-68d4-4037-8d8d-c06dc60841fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:37.026678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bd84b-68d4-4037-8d8d-c06dc60841fb service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:37.046704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 712/1434] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:37.880787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5cb7-1142-4b62-b526-d4da3ed074ca None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:37.881349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5cb7-1142-4b62-b526-d4da3ed074ca None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:37.881530 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5cb7-1142-4b62-b526-d4da3ed074ca None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:37.882974 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:37.888483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d831-533b-42c8-adc7-990f53374f6f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:37.889241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d831-533b-42c8-adc7-990f53374f6f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:37.889405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d831-533b-42c8-adc7-990f53374f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:37.974166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4786d831-533b-42c8-adc7-990f53374f6f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:37.976343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4786d831-533b-42c8-adc7-990f53374f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:38.026584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:38.091179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:38.248274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5cb7-1142-4b62-b526-d4da3ed074ca None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:38.249837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-30dd5cb7-1142-4b62-b526-d4da3ed074ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:38.416306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5cb7-1142-4b62-b526-d4da3ed074ca None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:38.487160 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:38.552501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7762db-58a3-4a79-b96f-42784dcf61eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:38.553107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7762db-58a3-4a79-b96f-42784dcf61eb service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:38.553702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7762db-58a3-4a79-b96f-42784dcf61eb service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:38.553702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7762db-58a3-4a79-b96f-42784dcf61eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:38.555322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6b7762db-58a3-4a79-b96f-42784dcf61eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:38.662911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7762db-58a3-4a79-b96f-42784dcf61eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:38.664552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7762db-58a3-4a79-b96f-42784dcf61eb service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:38.686052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 724/1437] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:39.521960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49630fd-b57b-4fb1-81db-7548f43a01ff None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:39.522568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49630fd-b57b-4fb1-81db-7548f43a01ff None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:39.522568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49630fd-b57b-4fb1-81db-7548f43a01ff None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:39.523932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:39.530636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591d246-0df4-49fd-9b18-eb126c4b77c4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:39.531193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591d246-0df4-49fd-9b18-eb126c4b77c4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:39.532129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591d246-0df4-49fd-9b18-eb126c4b77c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:39.657648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0591d246-0df4-49fd-9b18-eb126c4b77c4 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:39.659193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0591d246-0df4-49fd-9b18-eb126c4b77c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:39.661627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:39.802210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:39.962445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49630fd-b57b-4fb1-81db-7548f43a01ff None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:39.964793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e49630fd-b57b-4fb1-81db-7548f43a01ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:40.122942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49630fd-b57b-4fb1-81db-7548f43a01ff None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:40.152345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:40.275032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ba81-a37d-4a9b-9428-8550e311d426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:40.275950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ba81-a37d-4a9b-9428-8550e311d426 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:40.276658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ba81-a37d-4a9b-9428-8550e311d426 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:40.277043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ba81-a37d-4a9b-9428-8550e311d426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:40.279358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ac15ba81-a37d-4a9b-9428-8550e311d426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:40.388201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ba81-a37d-4a9b-9428-8550e311d426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:40.389721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ba81-a37d-4a9b-9428-8550e311d426 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:40.409901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 715/1440] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:42.440342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ea58-842f-4ca4-9e6f-014549179ece None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:42.440875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ea58-842f-4ca4-9e6f-014549179ece None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:42.440875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ea58-842f-4ca4-9e6f-014549179ece None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:42.442251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:42.448003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1fc78-91e4-42ff-b12a-9711910e1eae None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:42.448517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1fc78-91e4-42ff-b12a-9711910e1eae None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:42.448627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1fc78-91e4-42ff-b12a-9711910e1eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:42.495082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:42.525850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6ca1fc78-91e4-42ff-b12a-9711910e1eae None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:42.527173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6ca1fc78-91e4-42ff-b12a-9711910e1eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:42.638289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:42.682240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623ea58-842f-4ca4-9e6f-014549179ece None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:42.683738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9623ea58-842f-4ca4-9e6f-014549179ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:42.817427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623ea58-842f-4ca4-9e6f-014549179ece None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:42.857284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:42.913090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e14e1-9c9b-4a1b-9045-738a07f79e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:42.913730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e14e1-9c9b-4a1b-9045-738a07f79e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:42.913990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e14e1-9c9b-4a1b-9045-738a07f79e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:42.914261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e14e1-9c9b-4a1b-9045-738a07f79e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:42.916062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-642e14e1-9c9b-4a1b-9045-738a07f79e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:43.057883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e14e1-9c9b-4a1b-9045-738a07f79e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:43.059340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e14e1-9c9b-4a1b-9045-738a07f79e15 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:43.084801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 727/1443] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:30:45.368218 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d29b-9d25-4099-99b8-678605633856 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:45.368795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d29b-9d25-4099-99b8-678605633856 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:45.368795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d29b-9d25-4099-99b8-678605633856 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:45.369998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:45.376014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a15488-5a0f-4e8a-8330-bb06111991f3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:45.379564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a15488-5a0f-4e8a-8330-bb06111991f3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:45.379564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a15488-5a0f-4e8a-8330-bb06111991f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:45.461897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f1a15488-5a0f-4e8a-8330-bb06111991f3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:45.463174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f1a15488-5a0f-4e8a-8330-bb06111991f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:45.481260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:45.589620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:30:45.629287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55d29b-9d25-4099-99b8-678605633856 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:45.630841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3f55d29b-9d25-4099-99b8-678605633856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:45.748506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55d29b-9d25-4099-99b8-678605633856 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:45.764280 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:45.843433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa833a66-917d-4a61-bb02-f17277746690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:45.844033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833a66-917d-4a61-bb02-f17277746690 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:45.844320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833a66-917d-4a61-bb02-f17277746690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:45.844595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833a66-917d-4a61-bb02-f17277746690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:45.846248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aa833a66-917d-4a61-bb02-f17277746690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:45.973891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833a66-917d-4a61-bb02-f17277746690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:45.975456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833a66-917d-4a61-bb02-f17277746690 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:45.999527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 718/1446] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:48.430007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560416-d001-4929-88de-75c56f7749d5 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:48.430554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560416-d001-4929-88de-75c56f7749d5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:48.430554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560416-d001-4929-88de-75c56f7749d5 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:48.432589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:48.439175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbd4f4-1ae1-4970-86eb-266a0747c229 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:48.439771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbd4f4-1ae1-4970-86eb-266a0747c229 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:48.439879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbd4f4-1ae1-4970-86eb-266a0747c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:48.499062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:48.523629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a8bbd4f4-1ae1-4970-86eb-266a0747c229 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:48.524831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a8bbd4f4-1ae1-4970-86eb-266a0747c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:48.655269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:48.696574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0560416-d001-4929-88de-75c56f7749d5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:48.698614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b0560416-d001-4929-88de-75c56f7749d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:48.840158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0560416-d001-4929-88de-75c56f7749d5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:48.884060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:48.934029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d65ac2-fae7-441b-87bc-2835196caf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:48.934794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65ac2-fae7-441b-87bc-2835196caf1c service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:48.935077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65ac2-fae7-441b-87bc-2835196caf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:48.935352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65ac2-fae7-441b-87bc-2835196caf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:48.937056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c7d65ac2-fae7-441b-87bc-2835196caf1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:49.059622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d65ac2-fae7-441b-87bc-2835196caf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:49.061086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d65ac2-fae7-441b-87bc-2835196caf1c service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:49.082795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 730/1449] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:51.477161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935ad41-a2ac-4704-9b4b-6f8174413a74 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:51.477740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935ad41-a2ac-4704-9b4b-6f8174413a74 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:51.477740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935ad41-a2ac-4704-9b4b-6f8174413a74 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:51.479139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:51.484817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1595-f44a-4f4b-b23a-90ebe55b76d1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:51.485307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1595-f44a-4f4b-b23a-90ebe55b76d1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:51.485425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1595-f44a-4f4b-b23a-90ebe55b76d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:51.554586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-395b1595-f44a-4f4b-b23a-90ebe55b76d1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:51.555983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-395b1595-f44a-4f4b-b23a-90ebe55b76d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:51.576875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:51.657783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:51.697839 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935ad41-a2ac-4704-9b4b-6f8174413a74 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:51.699589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5935ad41-a2ac-4704-9b4b-6f8174413a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:51.819732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935ad41-a2ac-4704-9b4b-6f8174413a74 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:51.841425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:51.899894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187f26e-c1de-4296-8aef-e3b142b3255d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:51.900550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187f26e-c1de-4296-8aef-e3b142b3255d service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:51.900831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187f26e-c1de-4296-8aef-e3b142b3255d service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:51.901097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187f26e-c1de-4296-8aef-e3b142b3255d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:51.902774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4187f26e-c1de-4296-8aef-e3b142b3255d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:52.016476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187f26e-c1de-4296-8aef-e3b142b3255d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:52.017916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187f26e-c1de-4296-8aef-e3b142b3255d service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:52.035689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 721/1452] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:54.157644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64f04-4a9e-4bd6-9d85-e712c271ed6b None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:54.158447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64f04-4a9e-4bd6-9d85-e712c271ed6b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:54.158447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64f04-4a9e-4bd6-9d85-e712c271ed6b None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:54.159805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:54.165794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662d56-cf87-47c6-b756-a5d3d77adc17 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:54.166317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662d56-cf87-47c6-b756-a5d3d77adc17 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:54.166576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662d56-cf87-47c6-b756-a5d3d77adc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:54.246699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:54.249832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e6662d56-cf87-47c6-b756-a5d3d77adc17 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:54.252320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e6662d56-cf87-47c6-b756-a5d3d77adc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:54.369600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:54.412146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f64f04-4a9e-4bd6-9d85-e712c271ed6b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:54.413840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-37f64f04-4a9e-4bd6-9d85-e712c271ed6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:54.545269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f64f04-4a9e-4bd6-9d85-e712c271ed6b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:54.606862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:54.635574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74300f8d-bff2-4910-a8a7-113a5219cfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:54.636583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74300f8d-bff2-4910-a8a7-113a5219cfeb service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:54.637049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74300f8d-bff2-4910-a8a7-113a5219cfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:54.637521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74300f8d-bff2-4910-a8a7-113a5219cfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:54.640249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-74300f8d-bff2-4910-a8a7-113a5219cfeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:54.770440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74300f8d-bff2-4910-a8a7-113a5219cfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:54.771963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74300f8d-bff2-4910-a8a7-113a5219cfeb service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:54.793746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 733/1455] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:56.964645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8088f-4ea4-4651-9563-4d0af34ce2f1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:56.965449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8088f-4ea4-4651-9563-4d0af34ce2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:56.965449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8088f-4ea4-4651-9563-4d0af34ce2f1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:56.966571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:30:56.974044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb8565-49ac-4578-9920-0439a0ec86c0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:56.974044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb8565-49ac-4578-9920-0439a0ec86c0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:56.974044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb8565-49ac-4578-9920-0439a0ec86c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:57.043627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-27cb8565-49ac-4578-9920-0439a0ec86c0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:57.045103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-27cb8565-49ac-4578-9920-0439a0ec86c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:57.075269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:57.151734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:57.191341 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8088f-4ea4-4651-9563-4d0af34ce2f1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:57.192899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3df8088f-4ea4-4651-9563-4d0af34ce2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:57.304236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8088f-4ea4-4651-9563-4d0af34ce2f1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:30:57.333279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:57.381203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354929c-1742-4a92-97b3-0718bcb54615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:30:57.381835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354929c-1742-4a92-97b3-0718bcb54615 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:57.382120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354929c-1742-4a92-97b3-0718bcb54615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:57.382402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354929c-1742-4a92-97b3-0718bcb54615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:57.384089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e354929c-1742-4a92-97b3-0718bcb54615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:57.509653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354929c-1742-4a92-97b3-0718bcb54615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:30:57.511026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354929c-1742-4a92-97b3-0718bcb54615 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:30:57.529487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 724/1458] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:30:59.667919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6489-55c3-4003-a0d2-944fc3344706 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:59.668498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6489-55c3-4003-a0d2-944fc3344706 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:59.668498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6489-55c3-4003-a0d2-944fc3344706 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:59.670155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:30:59.676675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1513c-48ff-445e-b80c-85a1c22369ec None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:30:59.677201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1513c-48ff-445e-b80c-85a1c22369ec None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:30:59.677543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1513c-48ff-445e-b80c-85a1c22369ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:30:59.749144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-12d1513c-48ff-445e-b80c-85a1c22369ec None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:30:59.751139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-12d1513c-48ff-445e-b80c-85a1c22369ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:30:59.760067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:59.853799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:30:59.892118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6489-55c3-4003-a0d2-944fc3344706 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:30:59.893672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-565c6489-55c3-4003-a0d2-944fc3344706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:00.001571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6489-55c3-4003-a0d2-944fc3344706 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:00.059317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:00.081462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a7eb-2da6-4612-a87b-6c671298a6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:00.082117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a7eb-2da6-4612-a87b-6c671298a6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:00.082400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a7eb-2da6-4612-a87b-6c671298a6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:00.082676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a7eb-2da6-4612-a87b-6c671298a6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:00.084363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7843a7eb-2da6-4612-a87b-6c671298a6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:00.200156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a7eb-2da6-4612-a87b-6c671298a6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:00.201613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a7eb-2da6-4612-a87b-6c671298a6ca service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:00.222295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 736/1461] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:31:02.451172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8de2-c776-4dea-a12a-fa710011929a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:02.452103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8de2-c776-4dea-a12a-fa710011929a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:02.452103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8de2-c776-4dea-a12a-fa710011929a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:02.454160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:31:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:31:02.460566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a48e4-4a6c-477f-845c-32d18ea630e3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:02.461110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a48e4-4a6c-477f-845c-32d18ea630e3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:02.461223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a48e4-4a6c-477f-845c-32d18ea630e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:02.534480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c16a48e4-4a6c-477f-845c-32d18ea630e3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:02.535766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c16a48e4-4a6c-477f-845c-32d18ea630e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:02.581078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:02.651708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:31:02.690268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8de2-c776-4dea-a12a-fa710011929a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:02.691922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-692f8de2-c776-4dea-a12a-fa710011929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:02.806080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8de2-c776-4dea-a12a-fa710011929a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:02.844845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:02.886358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bb5bd-2230-44f9-8556-39a84ac265a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:02.886987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bb5bd-2230-44f9-8556-39a84ac265a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:02.887266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bb5bd-2230-44f9-8556-39a84ac265a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:02.887569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bb5bd-2230-44f9-8556-39a84ac265a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:02.889229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4a2bb5bd-2230-44f9-8556-39a84ac265a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:03.009039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bb5bd-2230-44f9-8556-39a84ac265a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:03.010501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bb5bd-2230-44f9-8556-39a84ac265a5 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:03.029096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 727/1464] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:31:05.108693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37df28-d1da-49e8-8188-1992a4e90fb4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:05.109284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37df28-d1da-49e8-8188-1992a4e90fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:05.109284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37df28-d1da-49e8-8188-1992a4e90fb4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:05.114998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:05.116233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd723de2-dd44-454c-b213-5f5eaf1629bb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:05.116687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd723de2-dd44-454c-b213-5f5eaf1629bb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:05.116788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd723de2-dd44-454c-b213-5f5eaf1629bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:05.188444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dd723de2-dd44-454c-b213-5f5eaf1629bb None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:05.189690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dd723de2-dd44-454c-b213-5f5eaf1629bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:05.209305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:05.294086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:31:05.333317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37df28-d1da-49e8-8188-1992a4e90fb4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:05.334883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-da37df28-d1da-49e8-8188-1992a4e90fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:05.447359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37df28-d1da-49e8-8188-1992a4e90fb4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:05.518724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:05.529434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f431d3b-33b7-48d4-a41a-1d3708428f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:05.530092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431d3b-33b7-48d4-a41a-1d3708428f2f service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:05.530371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431d3b-33b7-48d4-a41a-1d3708428f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:05.530642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431d3b-33b7-48d4-a41a-1d3708428f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:05.532376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4f431d3b-33b7-48d4-a41a-1d3708428f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:05.646653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431d3b-33b7-48d4-a41a-1d3708428f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:05.648156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431d3b-33b7-48d4-a41a-1d3708428f2f service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:05.671338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 739/1467] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:31:07.788808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8a16-c385-426a-9d2d-84ba5fd336a6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:07.789388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8a16-c385-426a-9d2d-84ba5fd336a6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:07.789388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8a16-c385-426a-9d2d-84ba5fd336a6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:07.790747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:07.797300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73473d-fabc-4599-b11f-009c6b655854 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:07.797813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73473d-fabc-4599-b11f-009c6b655854 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:07.797927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73473d-fabc-4599-b11f-009c6b655854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:07.873505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3d73473d-fabc-4599-b11f-009c6b655854 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:07.875343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3d73473d-fabc-4599-b11f-009c6b655854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:07.926375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:07.982132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:31:08.019392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8a16-c385-426a-9d2d-84ba5fd336a6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:08.020950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-281d8a16-c385-426a-9d2d-84ba5fd336a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:08.131521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8a16-c385-426a-9d2d-84ba5fd336a6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:08.180548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:08.208136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a1b6-026f-4db7-92ef-23b647801795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:08.208762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a1b6-026f-4db7-92ef-23b647801795 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:08.209042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a1b6-026f-4db7-92ef-23b647801795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:08.209314 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a1b6-026f-4db7-92ef-23b647801795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:08.210998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ed63a1b6-026f-4db7-92ef-23b647801795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:08.323253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63a1b6-026f-4db7-92ef-23b647801795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:08.324738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63a1b6-026f-4db7-92ef-23b647801795 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:08.344541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 730/1470] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:31:17.980236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=22 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:18.340698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=66 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:29.017660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cebcc-05f5-4d76-b66e-f78208feab47 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:29.018240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cebcc-05f5-4d76-b66e-f78208feab47 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:29.018240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cebcc-05f5-4d76-b66e-f78208feab47 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:29.019603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 741/1471] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:29.025627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e800c9-c82d-4034-83d9-8f03ca4ad21f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:29.030000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e800c9-c82d-4034-83d9-8f03ca4ad21f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:29.030000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e800c9-c82d-4034-83d9-8f03ca4ad21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:29.096569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f8e800c9-c82d-4034-83d9-8f03ca4ad21f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:29.097794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f8e800c9-c82d-4034-83d9-8f03ca4ad21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:29.200624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 731/1472] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:31:29.296858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bdc8-89a2-4b9c-87b3-d17d6dc410bb None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:29.297140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bdc8-89a2-4b9c-87b3-d17d6dc410bb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:29.297616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bdc8-89a2-4b9c-87b3-d17d6dc410bb None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:29.298962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 742/1473] 10.222.0.71 () {54 vars in 966 bytes} [Mon Aug 1 15:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:29.304082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87e39-d965-419e-b757-b80f50387130 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:29.304376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87e39-d965-419e-b757-b80f50387130 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:29.304654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87e39-d965-419e-b757-b80f50387130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:29.394282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3bd87e39-d965-419e-b757-b80f50387130 None None] MFA Rules not processed for user `f03250eb151044619c0f720f315b8509`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:29.395554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3bd87e39-d965-419e-b757-b80f50387130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:29.417241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:29.481633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 732/1474] 10.222.0.71 () {58 vars in 1063 bytes} [Mon Aug 1 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:31:29.489230 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bdc8-89a2-4b9c-87b3-d17d6dc410bb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:29.490756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-46e5bdc8-89a2-4b9c-87b3-d17d6dc410bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:29.603708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bdc8-89a2-4b9c-87b3-d17d6dc410bb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:29.682293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb7dc-7226-4ddd-8df3-2a88180e89b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03250eb151044619c0f720f315b8509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:29.682946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb7dc-7226-4ddd-8df3-2a88180e89b4 service glance] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:29.683263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb7dc-7226-4ddd-8df3-2a88180e89b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:29.683584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb7dc-7226-4ddd-8df3-2a88180e89b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:29.685261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-96cdb7dc-7226-4ddd-8df3-2a88180e89b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:29.742244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:29.798293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdb7dc-7226-4ddd-8df3-2a88180e89b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:29.799694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdb7dc-7226-4ddd-8df3-2a88180e89b4 service glance] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:29.818705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 743/1475] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:31:31.976982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d2c1-276d-43cb-9867-21764c672adc None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:31.977855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d2c1-276d-43cb-9867-21764c672adc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:31.978048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d2c1-276d-43cb-9867-21764c672adc None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:31.979546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 733/1476] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:31.985788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f85b1-c680-452f-b24d-7bca5db2cb84 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:31.986293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f85b1-c680-452f-b24d-7bca5db2cb84 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:31.986392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f85b1-c680-452f-b24d-7bca5db2cb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:32.056508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7a0f85b1-c680-452f-b24d-7bca5db2cb84 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:32.057741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7a0f85b1-c680-452f-b24d-7bca5db2cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:32.161416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 744/1477] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:31:32.185013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d2c1-276d-43cb-9867-21764c672adc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:32.186584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2c17d2c1-276d-43cb-9867-21764c672adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:32.318016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d2c1-276d-43cb-9867-21764c672adc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:32.368952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:32.416254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3946c-1649-4c47-933b-aaf9e9a07601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:32.416746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3946c-1649-4c47-933b-aaf9e9a07601 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:32.417030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3946c-1649-4c47-933b-aaf9e9a07601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:32.417301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3946c-1649-4c47-933b-aaf9e9a07601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:32.418009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3946c-1649-4c47-933b-aaf9e9a07601 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:32.420144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-b9e3946c-1649-4c47-933b-aaf9e9a07601 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:31:32.420144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: warnings.warn(msg) Aug 01 15:31:32.420144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: Aug 01 15:31:32.421958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3946c-1649-4c47-933b-aaf9e9a07601 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:32.441993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 734/1478] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Aug 1 15:31:32 2022] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:31:34.529584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faec53-5a4a-40ef-9b50-d6b205a6d1c7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:34.530106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faec53-5a4a-40ef-9b50-d6b205a6d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:34.530235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faec53-5a4a-40ef-9b50-d6b205a6d1c7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:34.531589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 745/1479] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:34.537121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702a1b-d675-4566-b0f8-93b21a0e39ac None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:34.537577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702a1b-d675-4566-b0f8-93b21a0e39ac None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:34.537700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702a1b-d675-4566-b0f8-93b21a0e39ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:34.607979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-00702a1b-d675-4566-b0f8-93b21a0e39ac None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:34.609292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-00702a1b-d675-4566-b0f8-93b21a0e39ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:34.708153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 735/1480] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:31:34.753215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faec53-5a4a-40ef-9b50-d6b205a6d1c7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:34.754814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f7faec53-5a4a-40ef-9b50-d6b205a6d1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:34.765092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:34.924827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faec53-5a4a-40ef-9b50-d6b205a6d1c7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:35.007749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:35.042091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af95bb8-c0bf-4ee6-be00-eb57d98cc2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:35.042714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95bb8-c0bf-4ee6-be00-eb57d98cc2bb service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:35.042991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95bb8-c0bf-4ee6-be00-eb57d98cc2bb service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:35.043265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95bb8-c0bf-4ee6-be00-eb57d98cc2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:35.045208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8af95bb8-c0bf-4ee6-be00-eb57d98cc2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:35.146979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af95bb8-c0bf-4ee6-be00-eb57d98cc2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:35.148535 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af95bb8-c0bf-4ee6-be00-eb57d98cc2bb service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:35.168216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 746/1481] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:31:37.451931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3bad-69bc-4e5e-a0d7-09ce86407540 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:37.452537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3bad-69bc-4e5e-a0d7-09ce86407540 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:37.452537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3bad-69bc-4e5e-a0d7-09ce86407540 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:37.453778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 736/1482] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:37.459794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac6f79-b5a9-4fd7-a461-0d687e38761d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:37.460301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac6f79-b5a9-4fd7-a461-0d687e38761d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:37.460401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac6f79-b5a9-4fd7-a461-0d687e38761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:37.530675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7dac6f79-b5a9-4fd7-a461-0d687e38761d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:37.531949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7dac6f79-b5a9-4fd7-a461-0d687e38761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:37.580145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:37.632123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 747/1483] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:31:37.668688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a3bad-69bc-4e5e-a0d7-09ce86407540 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:37.670495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-700a3bad-69bc-4e5e-a0d7-09ce86407540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:37.695787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:37.782872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a3bad-69bc-4e5e-a0d7-09ce86407540 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:37.865175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1310f5-9445-445c-97dd-c73ecb0863fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:37.866021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1310f5-9445-445c-97dd-c73ecb0863fe service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:37.866021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1310f5-9445-445c-97dd-c73ecb0863fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:37.866243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1310f5-9445-445c-97dd-c73ecb0863fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:37.868222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3d1310f5-9445-445c-97dd-c73ecb0863fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:37.945102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:37.983164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1310f5-9445-445c-97dd-c73ecb0863fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:37.985912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1310f5-9445-445c-97dd-c73ecb0863fe service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:38.004677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 737/1484] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:31:40.094966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77af76-8960-4442-b9ae-76555ff5be3a None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:40.094966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77af76-8960-4442-b9ae-76555ff5be3a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:40.097044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77af76-8960-4442-b9ae-76555ff5be3a None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:40.097044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 748/1485] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:31:40.104642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e05d-a7e9-4e8e-ab7e-56803615e8ff None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:40.105115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e05d-a7e9-4e8e-ab7e-56803615e8ff None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:40.105302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e05d-a7e9-4e8e-ab7e-56803615e8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:40.191565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4be4e05d-a7e9-4e8e-ab7e-56803615e8ff None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:40.192861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4be4e05d-a7e9-4e8e-ab7e-56803615e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:40.301335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 738/1486] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:31:40.339296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77af76-8960-4442-b9ae-76555ff5be3a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:40.340873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4c77af76-8960-4442-b9ae-76555ff5be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:40.453600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77af76-8960-4442-b9ae-76555ff5be3a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:40.530799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:40.533335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb911af1-9957-418f-a95e-7a76df55a366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:40.534154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911af1-9957-418f-a95e-7a76df55a366 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:40.534628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911af1-9957-418f-a95e-7a76df55a366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:40.534970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911af1-9957-418f-a95e-7a76df55a366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:40.537001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-eb911af1-9957-418f-a95e-7a76df55a366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:40.657881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911af1-9957-418f-a95e-7a76df55a366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:40.659273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911af1-9957-418f-a95e-7a76df55a366 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:40.679684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 749/1487] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:31:42.870618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89778eb-a2df-4c78-b667-73153c534a97 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:42.871245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89778eb-a2df-4c78-b667-73153c534a97 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:42.871245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89778eb-a2df-4c78-b667-73153c534a97 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:42.872693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 739/1488] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:42.880368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5e7ef-ec4b-49bd-9cfa-85362bf68dbe None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:42.880906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5e7ef-ec4b-49bd-9cfa-85362bf68dbe None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:42.881203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5e7ef-ec4b-49bd-9cfa-85362bf68dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:42.976247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-61b5e7ef-ec4b-49bd-9cfa-85362bf68dbe None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:42.977556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-61b5e7ef-ec4b-49bd-9cfa-85362bf68dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:43.043142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:43.096743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 750/1489] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:31:43.146106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89778eb-a2df-4c78-b667-73153c534a97 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:43.148974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e89778eb-a2df-4c78-b667-73153c534a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:43.196331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:43.271530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89778eb-a2df-4c78-b667-73153c534a97 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:43.352666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d017e58-2ad5-4c72-b11b-3ec2dc75a3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:43.353299 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d017e58-2ad5-4c72-b11b-3ec2dc75a3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:43.353586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d017e58-2ad5-4c72-b11b-3ec2dc75a3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:43.353864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d017e58-2ad5-4c72-b11b-3ec2dc75a3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:43.355566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9d017e58-2ad5-4c72-b11b-3ec2dc75a3e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:43.446998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:43.481533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d017e58-2ad5-4c72-b11b-3ec2dc75a3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:43.482985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d017e58-2ad5-4c72-b11b-3ec2dc75a3e6 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:43.502063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 740/1490] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:31:45.829169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fb939-4d8b-45d8-b3fb-ea7ef2fca152 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:45.829768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fb939-4d8b-45d8-b3fb-ea7ef2fca152 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:45.829768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fb939-4d8b-45d8-b3fb-ea7ef2fca152 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:45.831127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 751/1491] 10.222.0.71 () {54 vars in 926 bytes} [Mon Aug 1 15:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:31:45.837014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5e73-34bb-4eb0-80a1-9757b75583fb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:45.837546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5e73-34bb-4eb0-80a1-9757b75583fb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:45.837654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5e73-34bb-4eb0-80a1-9757b75583fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:45.910760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b9ff5e73-34bb-4eb0-80a1-9757b75583fb None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:31:45.912052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b9ff5e73-34bb-4eb0-80a1-9757b75583fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:46.018324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 741/1492] 10.222.0.71 () {58 vars in 1023 bytes} [Mon Aug 1 15:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:31:46.059729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fb939-4d8b-45d8-b3fb-ea7ef2fca152 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:31:46.061326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-501fb939-4d8b-45d8-b3fb-ea7ef2fca152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:46.188338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fb939-4d8b-45d8-b3fb-ea7ef2fca152 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:31:46.274995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32781581-6920-48f3-8431-5820a19620a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:31:46.275658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32781581-6920-48f3-8431-5820a19620a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:31:46.276040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32781581-6920-48f3-8431-5820a19620a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:31:46.276471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32781581-6920-48f3-8431-5820a19620a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:31:46.278384 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-32781581-6920-48f3-8431-5820a19620a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:31:46.289173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:46.411920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32781581-6920-48f3-8431-5820a19620a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:31:46.413427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32781581-6920-48f3-8431-5820a19620a9 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:31:46.433595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 752/1493] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:31:56.016500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=82 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:56.430923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=50 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:16.300130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4667c2-3388-47b1-b273-53d5898c0414 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:16.300750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4667c2-3388-47b1-b273-53d5898c0414 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:16.301168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4667c2-3388-47b1-b273-53d5898c0414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:16.389258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4e4667c2-3388-47b1-b273-53d5898c0414 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:33:16.390500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4e4667c2-3388-47b1-b273-53d5898c0414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:16.509020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 742/1494] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:33:16.517758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea1f2-876f-48a0-9682-acc531b746b2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:16.518304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea1f2-876f-48a0-9682-acc531b746b2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:16.518304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea1f2-876f-48a0-9682-acc531b746b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:16.611217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7cdea1f2-876f-48a0-9682-acc531b746b2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:33:16.612496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7cdea1f2-876f-48a0-9682-acc531b746b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:16.718189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 753/1495] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:33:16.723103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4667c2-3388-47b1-b273-53d5898c0414 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:16.724368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4e4667c2-3388-47b1-b273-53d5898c0414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:16.736563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4667c2-3388-47b1-b273-53d5898c0414 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:16.807319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:16.845204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:16.845834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:16.846404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:16.846724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:16.847698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:33:16.847858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:16.848997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:33:16.848997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: warnings.warn(msg) Aug 01 15:33:16.848997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: Aug 01 15:33:16.849715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:16.863849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 743/1496] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:33:16.874326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdea1f2-876f-48a0-9682-acc531b746b2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:16.884547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdea1f2-876f-48a0-9682-acc531b746b2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:16.968022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:17.007493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:17.008130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:17.008420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:17.008699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:17.009373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:17.011468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING py.warnings [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:33:17.011468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: warnings.warn(msg) Aug 01 15:33:17.011468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: Aug 01 15:33:17.012827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:17.075656 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 754/1497] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:33:16 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:33:17.079917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:17.081527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:17.120454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ba95-6fc9-49e6-b0f8-f69a6d7d14be admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:17.242952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:17.243668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:17.243979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:17.244253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:17.244950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:17.246141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:33:17.246141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: warnings.warn(msg) Aug 01 15:33:17.246141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: Aug 01 15:33:17.247544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:17.305432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 744/1498] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:33:17 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:33:17.310021 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:17.312287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:17.382736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1810b8-2e21-4140-9975-8bab2a76b66c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:17.474593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:17.486308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:17.486933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:17.487210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:17.487515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:17.488211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:17.489226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING py.warnings [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:33:17.489226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: warnings.warn(msg) Aug 01 15:33:17.489226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: Aug 01 15:33:17.490103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:17.503993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 755/1499] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:33:17.508225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:17.509788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:17.522244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a97d5-3086-48c0-a0e0-669e55ecd68c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:17.562048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:17.642615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926422d-2b42-4f96-8ddc-ebbfe08a4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:17.643147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926422d-2b42-4f96-8ddc-ebbfe08a4dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:17.643452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926422d-2b42-4f96-8ddc-ebbfe08a4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:17.643731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926422d-2b42-4f96-8ddc-ebbfe08a4dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:17.644559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926422d-2b42-4f96-8ddc-ebbfe08a4dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:17.645500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-7926422d-2b42-4f96-8ddc-ebbfe08a4dc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:33:17.645500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: warnings.warn(msg) Aug 01 15:33:17.645500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: Aug 01 15:33:17.646390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926422d-2b42-4f96-8ddc-ebbfe08a4dc9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:17.659472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 745/1500] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:33:17.663758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:17.665228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:17.702837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedf17d-1712-4fa6-9258-5f16322ddca2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:17.814274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070423-3443-4ae2-867b-fd3cc4855848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:17.814879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070423-3443-4ae2-867b-fd3cc4855848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:17.815287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070423-3443-4ae2-867b-fd3cc4855848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:17.815485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070423-3443-4ae2-867b-fd3cc4855848 admin admin] PATH_INFO: `/v3/projects/c34d38c4d1cd403da65d5d60034ccc60/users/d593fe25a1374727adef56f8104ef268/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:17.843087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72070423-3443-4ae2-867b-fd3cc4855848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34d38c4d1cd403da65d5d60034ccc60, user_id=d593fe25a1374727adef56f8104ef268, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:17.844201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING py.warnings [None req-72070423-3443-4ae2-867b-fd3cc4855848 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:33:17.844201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: warnings.warn(msg) Aug 01 15:33:17.844201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: Aug 01 15:33:17.846172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72070423-3443-4ae2-867b-fd3cc4855848 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:17.875056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 756/1501] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:33:17 2022] PUT /identity/v3/projects/c34d38c4d1cd403da65d5d60034ccc60/users/d593fe25a1374727adef56f8104ef268/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:33:17.888564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08fa6f-eb73-4372-a515-b2ebc58e9543 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:17.888564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08fa6f-eb73-4372-a515-b2ebc58e9543 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:17.888564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08fa6f-eb73-4372-a515-b2ebc58e9543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:17.965221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7f08fa6f-eb73-4372-a515-b2ebc58e9543 None None] MFA Rules not processed for user `d593fe25a1374727adef56f8104ef268`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:33:17.966366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7f08fa6f-eb73-4372-a515-b2ebc58e9543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:18.093321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 746/1502] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:33:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:33:18.106943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1985b-eb07-45b5-a7b3-39af50a8e45d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:18.107226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1985b-eb07-45b5-a7b3-39af50a8e45d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:18.107567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1985b-eb07-45b5-a7b3-39af50a8e45d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:18.108936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 757/1503] 10.222.0.71 () {54 vars in 964 bytes} [Mon Aug 1 15:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:33:18.114143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786d24c-24a5-400f-a9bd-4facad449cd9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:18.114437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786d24c-24a5-400f-a9bd-4facad449cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:18.114713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786d24c-24a5-400f-a9bd-4facad449cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:18.147072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:18.196792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a786d24c-24a5-400f-a9bd-4facad449cd9 None None] MFA Rules not processed for user `79a4e12e752446f296569df09f2ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:33:18.198030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a786d24c-24a5-400f-a9bd-4facad449cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:18.299746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 747/1504] 10.222.0.71 () {58 vars in 1061 bytes} [Mon Aug 1 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:33:18.307800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1985b-eb07-45b5-a7b3-39af50a8e45d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:18.309454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-84e1985b-eb07-45b5-a7b3-39af50a8e45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:18.368924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:18.431448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1985b-eb07-45b5-a7b3-39af50a8e45d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:18.516661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:18.517537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:18.517921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:18.518296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:18.520283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:18.626290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:18.627869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:18.632138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:18.649893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 758/1505] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:33:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:33:18.705987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56ce02-439f-4a56-b68b-b6a1cf98f4a5 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:18.706522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56ce02-439f-4a56-b68b-b6a1cf98f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:18.706622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56ce02-439f-4a56-b68b-b6a1cf98f4a5 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:18.707956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 748/1506] 10.222.0.71 () {52 vars in 830 bytes} [Mon Aug 1 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:33:18.712214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:18.713561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:18.822400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadcdeb-3f03-42a3-8d36-c4c8167b9452 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:18.922742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:18.923420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:18.923708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:18.923987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] PATH_INFO: `/v3/users/d593fe25a1374727adef56f8104ef268` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:18.937821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d593fe25a1374727adef56f8104ef268)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:18.938874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING py.warnings [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:33:18.938874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: warnings.warn(msg) Aug 01 15:33:18.938874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: Aug 01 15:33:18.940149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:18.951683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:19.033721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd593fe25a1374727adef56f8104ef268'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:19.044883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd593fe25a1374727adef56f8104ef268'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:19.045874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd593fe25a1374727adef56f8104ef268'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:19.073480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd593fe25a1374727adef56f8104ef268'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:19.074042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd593fe25a1374727adef56f8104ef268'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:19.100509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 759/1507] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:33:18 2022] DELETE /identity/v3/users/d593fe25a1374727adef56f8104ef268 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:33:19.105257 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f1288-0947-4db4-a7bd-11af46cced33 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:19.105707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f1288-0947-4db4-a7bd-11af46cced33 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:19.106089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f1288-0947-4db4-a7bd-11af46cced33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:19.169414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e40f1288-0947-4db4-a7bd-11af46cced33 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:33:19.170914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e40f1288-0947-4db4-a7bd-11af46cced33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:19.261710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:19.279583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 749/1508] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:33:19.291304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:19.292600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:19.408740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80c448-73dd-4066-b688-90e58c80e36a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:19.467317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:19.488934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072df8f-97b9-4ad6-a8c5-c8c97232f291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:19.489567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072df8f-97b9-4ad6-a8c5-c8c97232f291 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:19.489850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072df8f-97b9-4ad6-a8c5-c8c97232f291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:19.490127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072df8f-97b9-4ad6-a8c5-c8c97232f291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:19.491822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3072df8f-97b9-4ad6-a8c5-c8c97232f291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:19.620752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072df8f-97b9-4ad6-a8c5-c8c97232f291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:19.622861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072df8f-97b9-4ad6-a8c5-c8c97232f291 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:19.642920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 760/1509] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:33:20.001239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f1288-0947-4db4-a7bd-11af46cced33 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:33:20.002529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e40f1288-0947-4db4-a7bd-11af46cced33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:33:20.015611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f1288-0947-4db4-a7bd-11af46cced33 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:33:20.127476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:33:20.128133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:33:20.128408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:33:20.128678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] PATH_INFO: `/v3/projects/c34d38c4d1cd403da65d5d60034ccc60` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:33:20.140560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34d38c4d1cd403da65d5d60034ccc60)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:33:20.141597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:33:20.141597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: warnings.warn(msg) Aug 01 15:33:20.141597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: Aug 01 15:33:20.142805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:33:20.209438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34d38c4d1cd403da65d5d60034ccc60', 'request_id': 'req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:20.220760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34d38c4d1cd403da65d5d60034ccc60', 'request_id': 'req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:20.228414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34d38c4d1cd403da65d5d60034ccc60', 'request_id': 'req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:20.261335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] The token cache is being invalidate because project c34d38c4d1cd403da65d5d60034ccc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:33:20.261628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:20.262167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e363c2c7-98fe-406a-baa0-eea78f8bb6b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:33:20.264081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 750/1510] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:33:20 2022] DELETE /identity/v3/projects/c34d38c4d1cd403da65d5d60034ccc60 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:33:29.640430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=62 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:30.259266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:13.083104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba95e5-4ff1-4120-932a-73a997640424 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:13.083104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba95e5-4ff1-4120-932a-73a997640424 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:13.084026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba95e5-4ff1-4120-932a-73a997640424 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:13.084573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:13.089988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37bc5-6071-430b-9774-7209de02a024 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:13.090480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37bc5-6071-430b-9774-7209de02a024 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:13.090588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37bc5-6071-430b-9774-7209de02a024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:13.179798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cbd37bc5-6071-430b-9774-7209de02a024 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:13.181021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cbd37bc5-6071-430b-9774-7209de02a024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:13.316645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:13.497006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba95e5-4ff1-4120-932a-73a997640424 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:13.499762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-08ba95e5-4ff1-4120-932a-73a997640424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:13.635225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba95e5-4ff1-4120-932a-73a997640424 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:13.641697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc53e0-7eb0-4929-8370-ea7c4905f71c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:13.642353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc53e0-7eb0-4929-8370-ea7c4905f71c service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:13.642353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc53e0-7eb0-4929-8370-ea7c4905f71c service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:13.642620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc53e0-7eb0-4929-8370-ea7c4905f71c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:13.651648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc53e0-7eb0-4929-8370-ea7c4905f71c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:13.653280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc53e0-7eb0-4929-8370-ea7c4905f71c service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:13.664228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 762/1513] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:14.531333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c24e-fd41-414c-a5c0-88f3f2a89c3a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.531920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c24e-fd41-414c-a5c0-88f3f2a89c3a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.531920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c24e-fd41-414c-a5c0-88f3f2a89c3a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.533253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:14.538719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e1da-71ea-407f-a22b-1ecb9f786319 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.539250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e1da-71ea-407f-a22b-1ecb9f786319 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.539250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e1da-71ea-407f-a22b-1ecb9f786319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.559143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3e00e1da-71ea-407f-a22b-1ecb9f786319 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:14.560390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3e00e1da-71ea-407f-a22b-1ecb9f786319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:14.569222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:14.723134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45c24e-fd41-414c-a5c0-88f3f2a89c3a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:14.737430 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45c24e-fd41-414c-a5c0-88f3f2a89c3a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:14.743865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cb3a6-d1cc-43fa-aba6-6b3798f3f481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:14.744481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb3a6-d1cc-43fa-aba6-6b3798f3f481 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.744761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb3a6-d1cc-43fa-aba6-6b3798f3f481 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.745034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb3a6-d1cc-43fa-aba6-6b3798f3f481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.753845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cb3a6-d1cc-43fa-aba6-6b3798f3f481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:14.755563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cb3a6-d1cc-43fa-aba6-6b3798f3f481 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:14.766573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 753/1516] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:16.430539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3876-13d5-4313-8e73-3a9284295202 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:16.431086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3876-13d5-4313-8e73-3a9284295202 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:16.431086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3876-13d5-4313-8e73-3a9284295202 None None] PATH_INFO: `/v3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:16.432463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 764/1517] 10.222.0.75 () {54 vars in 925 bytes} [Mon Aug 1 15:35:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:16.451221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a5108-1985-40bb-8070-29cb0028145c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:16.452377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a5108-1985-40bb-8070-29cb0028145c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:16.452834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a5108-1985-40bb-8070-29cb0028145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:16.533197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b49a5108-1985-40bb-8070-29cb0028145c None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:16.534508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b49a5108-1985-40bb-8070-29cb0028145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:16.556566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:16.618783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 754/1518] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Aug 1 15:35:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:24.554318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=56 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:26.016046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7b1b-481d-48a2-8626-59bb0e5a1467 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.017001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7b1b-481d-48a2-8626-59bb0e5a1467 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.017001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7b1b-481d-48a2-8626-59bb0e5a1467 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.018034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 765/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:26.023458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07325193-960b-47de-8039-660a17cee998 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.023994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07325193-960b-47de-8039-660a17cee998 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.023994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07325193-960b-47de-8039-660a17cee998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.047146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-07325193-960b-47de-8039-660a17cee998 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:26.048688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-07325193-960b-47de-8039-660a17cee998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:26.057327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 755/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:26.211087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7b1b-481d-48a2-8626-59bb0e5a1467 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:26.227543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7b1b-481d-48a2-8626-59bb0e5a1467 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:26.233882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa4acd-4730-4e67-b1a0-fa6a5bd069c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:26.234498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4acd-4730-4e67-b1a0-fa6a5bd069c3 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.234776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4acd-4730-4e67-b1a0-fa6a5bd069c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.235044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4acd-4730-4e67-b1a0-fa6a5bd069c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.244556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa4acd-4730-4e67-b1a0-fa6a5bd069c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:26.246151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa4acd-4730-4e67-b1a0-fa6a5bd069c3 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:26.256368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 766/1521] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:35:27.099836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25303d16-295a-45d7-b5fe-778fe124958b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.100526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25303d16-295a-45d7-b5fe-778fe124958b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.100526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25303d16-295a-45d7-b5fe-778fe124958b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.101746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:27.106901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b0ac-3c75-45b7-9297-23f3c0881c61 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.107360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b0ac-3c75-45b7-9297-23f3c0881c61 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.107518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b0ac-3c75-45b7-9297-23f3c0881c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.133867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-af07b0ac-3c75-45b7-9297-23f3c0881c61 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:27.135064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-af07b0ac-3c75-45b7-9297-23f3c0881c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:27.143543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:35:27.296610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25303d16-295a-45d7-b5fe-778fe124958b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.311734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25303d16-295a-45d7-b5fe-778fe124958b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:27.317163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4bc2a-1d23-4184-9c85-8f6453e98eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:27.317774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4bc2a-1d23-4184-9c85-8f6453e98eab service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.318061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4bc2a-1d23-4184-9c85-8f6453e98eab service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.318338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4bc2a-1d23-4184-9c85-8f6453e98eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.326488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4bc2a-1d23-4184-9c85-8f6453e98eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:27.328107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4bc2a-1d23-4184-9c85-8f6453e98eab service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:27.337544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 757/1524] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:27.954919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed28b80-3409-4fbe-91fe-5ed960bcc3db None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.955178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed28b80-3409-4fbe-91fe-5ed960bcc3db None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.955327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed28b80-3409-4fbe-91fe-5ed960bcc3db None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.956712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 768/1525] 10.222.0.71 () {54 vars in 961 bytes} [Mon Aug 1 15:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:27.961970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600925ac-0697-41ec-87a6-787572b29a70 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.962261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600925ac-0697-41ec-87a6-787572b29a70 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.962544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600925ac-0697-41ec-87a6-787572b29a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.984441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-600925ac-0697-41ec-87a6-787572b29a70 None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:27.985678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-600925ac-0697-41ec-87a6-787572b29a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:27.994587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 758/1526] 10.222.0.71 () {58 vars in 1058 bytes} [Mon Aug 1 15:35:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:28.003006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed28b80-3409-4fbe-91fe-5ed960bcc3db None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:28.018076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed28b80-3409-4fbe-91fe-5ed960bcc3db None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.023784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5f1c2-06cc-4c0d-9bd6-4f57447b8059 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.024489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f1c2-06cc-4c0d-9bd6-4f57447b8059 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.024812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f1c2-06cc-4c0d-9bd6-4f57447b8059 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.025120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f1c2-06cc-4c0d-9bd6-4f57447b8059 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.036143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5f1c2-06cc-4c0d-9bd6-4f57447b8059 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.037876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5f1c2-06cc-4c0d-9bd6-4f57447b8059 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.048735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 769/1527] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:31.686111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f7af-7691-4de6-af63-3694869a789f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.686687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f7af-7691-4de6-af63-3694869a789f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.686687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f7af-7691-4de6-af63-3694869a789f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.688113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:31.693634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3604be-e017-4bb9-8dff-41d6436e4980 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.694084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3604be-e017-4bb9-8dff-41d6436e4980 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.694200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3604be-e017-4bb9-8dff-41d6436e4980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.714395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5d3604be-e017-4bb9-8dff-41d6436e4980 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:31.715697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5d3604be-e017-4bb9-8dff-41d6436e4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:31.723628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:31.813760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214f7af-7691-4de6-af63-3694869a789f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:31.816080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b214f7af-7691-4de6-af63-3694869a789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:31.912553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214f7af-7691-4de6-af63-3694869a789f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:31.916307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25215e-dd1a-4338-afd1-3aa9330ab6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:31.916934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25215e-dd1a-4338-afd1-3aa9330ab6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.917217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25215e-dd1a-4338-afd1-3aa9330ab6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.917496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25215e-dd1a-4338-afd1-3aa9330ab6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.928103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25215e-dd1a-4338-afd1-3aa9330ab6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:31.929606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25215e-dd1a-4338-afd1-3aa9330ab6e6 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:31.940568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 760/1530] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:34.023087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f51c-9655-4766-8180-ab993c1c234c None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.023689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f51c-9655-4766-8180-ab993c1c234c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.023689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f51c-9655-4766-8180-ab993c1c234c None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.025107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:34.030662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809f8a-9781-4c1d-b96a-ef7b6a390e68 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.031103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809f8a-9781-4c1d-b96a-ef7b6a390e68 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.031230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809f8a-9781-4c1d-b96a-ef7b6a390e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.051737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9d809f8a-9781-4c1d-b96a-ef7b6a390e68 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:34.052955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9d809f8a-9781-4c1d-b96a-ef7b6a390e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:34.061655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:35:34.097490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f51c-9655-4766-8180-ab993c1c234c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:34.109065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f51c-9655-4766-8180-ab993c1c234c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:34.112595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81e52c-5797-47bc-893c-e70b003fcc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:34.113224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81e52c-5797-47bc-893c-e70b003fcc29 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.113510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81e52c-5797-47bc-893c-e70b003fcc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.113788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81e52c-5797-47bc-893c-e70b003fcc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.124646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81e52c-5797-47bc-893c-e70b003fcc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:34.126160 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81e52c-5797-47bc-893c-e70b003fcc29 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:34.136838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 772/1533] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:38.017473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1d8f-b0a2-4006-b9fb-d5fabb312e57 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.018042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1d8f-b0a2-4006-b9fb-d5fabb312e57 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.018042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1d8f-b0a2-4006-b9fb-d5fabb312e57 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.019437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:38.025378 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286de4-9101-4a3b-9a38-28bb1487a791 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.026559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286de4-9101-4a3b-9a38-28bb1487a791 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.026559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286de4-9101-4a3b-9a38-28bb1487a791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.052305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1b286de4-9101-4a3b-9a38-28bb1487a791 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:38.053532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1b286de4-9101-4a3b-9a38-28bb1487a791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:38.063334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:35:38.385270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e1d8f-b0a2-4006-b9fb-d5fabb312e57 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:38.387127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2d3e1d8f-b0a2-4006-b9fb-d5fabb312e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:38.457388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:38.471936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e1d8f-b0a2-4006-b9fb-d5fabb312e57 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:38.475674 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a5bde-a04d-4c91-8d9b-fcb897751171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:38.476386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5bde-a04d-4c91-8d9b-fcb897751171 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.476386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5bde-a04d-4c91-8d9b-fcb897751171 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.477021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5bde-a04d-4c91-8d9b-fcb897751171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.486958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a5bde-a04d-4c91-8d9b-fcb897751171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:38.488422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a5bde-a04d-4c91-8d9b-fcb897751171 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:38.499247 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 763/1536] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:40.597742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb74e0-a7e5-4853-93f7-56ebfcf3bd66 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.598313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb74e0-a7e5-4853-93f7-56ebfcf3bd66 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.598313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb74e0-a7e5-4853-93f7-56ebfcf3bd66 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.599704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:40.606734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac747e6-08ea-444a-a2f3-26ed8886fdef None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.607225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac747e6-08ea-444a-a2f3-26ed8886fdef None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.607334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac747e6-08ea-444a-a2f3-26ed8886fdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.628607 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bac747e6-08ea-444a-a2f3-26ed8886fdef None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:40.630058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bac747e6-08ea-444a-a2f3-26ed8886fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:40.638311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:40.956125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb74e0-a7e5-4853-93f7-56ebfcf3bd66 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:40.958175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-54cb74e0-a7e5-4853-93f7-56ebfcf3bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:40.972667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb74e0-a7e5-4853-93f7-56ebfcf3bd66 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:40.976690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f703d8c-6bb4-48da-bf33-fc2095fe1f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:40.977243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703d8c-6bb4-48da-bf33-fc2095fe1f69 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.977554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703d8c-6bb4-48da-bf33-fc2095fe1f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.977829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703d8c-6bb4-48da-bf33-fc2095fe1f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.989140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f703d8c-6bb4-48da-bf33-fc2095fe1f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:40.990735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f703d8c-6bb4-48da-bf33-fc2095fe1f69 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:41.002583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 775/1539] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:50.622444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=11 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:50.996883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=33 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.416849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f63f-8ced-4750-a264-75f08bf98681 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.418130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f63f-8ced-4750-a264-75f08bf98681 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.419334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f63f-8ced-4750-a264-75f08bf98681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.452632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-46a1f63f-8ced-4750-a264-75f08bf98681 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:28.453950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46a1f63f-8ced-4750-a264-75f08bf98681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:28.466664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 765/1540] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:28.475903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7234bbb-4ad2-447a-ad90-cefd62718a7a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.476516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7234bbb-4ad2-447a-ad90-cefd62718a7a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.476516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7234bbb-4ad2-447a-ad90-cefd62718a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.516670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a7234bbb-4ad2-447a-ad90-cefd62718a7a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:28.518772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a7234bbb-4ad2-447a-ad90-cefd62718a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:28.531789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 776/1541] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:28.538435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1f63f-8ced-4750-a264-75f08bf98681 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:28.553558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1f63f-8ced-4750-a264-75f08bf98681 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:28.570583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8851e2-051a-40a4-b0ce-b1c0dcafd321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:28.571228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8851e2-051a-40a4-b0ce-b1c0dcafd321 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.574328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8851e2-051a-40a4-b0ce-b1c0dcafd321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.574328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8851e2-051a-40a4-b0ce-b1c0dcafd321 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.574328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8851e2-051a-40a4-b0ce-b1c0dcafd321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:28.574328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8851e2-051a-40a4-b0ce-b1c0dcafd321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:28.575363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8851e2-051a-40a4-b0ce-b1c0dcafd321 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:28.594132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 766/1542] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:28.611847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7234bbb-4ad2-447a-ad90-cefd62718a7a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:28.627592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7234bbb-4ad2-447a-ad90-cefd62718a7a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:28.638601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f329f-4ece-4c27-b374-b87e5c03a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:28.639546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f329f-4ece-4c27-b374-b87e5c03a826 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.639840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f329f-4ece-4c27-b374-b87e5c03a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.640170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f329f-4ece-4c27-b374-b87e5c03a826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.641417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f329f-4ece-4c27-b374-b87e5c03a826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:28.645762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f329f-4ece-4c27-b374-b87e5c03a826 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:28.690130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4ea0-a5f7-42e5-b5c4-3d084ece521b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.690442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4ea0-a5f7-42e5-b5c4-3d084ece521b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.690681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4ea0-a5f7-42e5-b5c4-3d084ece521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.736142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 777/1543] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:28 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:28.737458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad3fb3-879b-4e6b-bac0-a2848d12d4d8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.737760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad3fb3-879b-4e6b-bac0-a2848d12d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.738055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad3fb3-879b-4e6b-bac0-a2848d12d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.740153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fc3b4ea0-a5f7-42e5-b5c4-3d084ece521b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:28.741485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fc3b4ea0-a5f7-42e5-b5c4-3d084ece521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:28.776552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1fad3fb3-879b-4e6b-bac0-a2848d12d4d8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:28.777756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1fad3fb3-879b-4e6b-bac0-a2848d12d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:28.878023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 767/1544] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:28.878889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b4ea0-a5f7-42e5-b5c4-3d084ece521b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:28.896000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b4ea0-a5f7-42e5-b5c4-3d084ece521b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:28.910606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30136536-6707-4c23-83c4-5aea38b5447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:28.911616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30136536-6707-4c23-83c4-5aea38b5447b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.912113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30136536-6707-4c23-83c4-5aea38b5447b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.912584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30136536-6707-4c23-83c4-5aea38b5447b admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.913450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30136536-6707-4c23-83c4-5aea38b5447b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:28.915624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30136536-6707-4c23-83c4-5aea38b5447b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.002102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 778/1545] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.003892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 768/1546] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:28 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:29.005620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783331be-e31a-44e9-88db-f09eaebd3203 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.006061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783331be-e31a-44e9-88db-f09eaebd3203 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.006476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783331be-e31a-44e9-88db-f09eaebd3203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.010088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d5197-7434-4109-a907-2649c877cc07 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.010540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d5197-7434-4109-a907-2649c877cc07 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.010972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d5197-7434-4109-a907-2649c877cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.062740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-783331be-e31a-44e9-88db-f09eaebd3203 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.064441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-783331be-e31a-44e9-88db-f09eaebd3203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.072385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-595d5197-7434-4109-a907-2649c877cc07 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.074296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-595d5197-7434-4109-a907-2649c877cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.093055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 779/1547] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.093960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783331be-e31a-44e9-88db-f09eaebd3203 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.100040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 769/1548] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.102285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0366084-b688-4bed-9cc2-e33dcf7dd15c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.102784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0366084-b688-4bed-9cc2-e33dcf7dd15c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.103221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0366084-b688-4bed-9cc2-e33dcf7dd15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.109657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783331be-e31a-44e9-88db-f09eaebd3203 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.119347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf473-644b-4a14-9ae9-9bc3fd356026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.120020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf473-644b-4a14-9ae9-9bc3fd356026 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.120302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf473-644b-4a14-9ae9-9bc3fd356026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.120578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf473-644b-4a14-9ae9-9bc3fd356026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.121314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cf473-644b-4a14-9ae9-9bc3fd356026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.122939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cf473-644b-4a14-9ae9-9bc3fd356026 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.146234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 780/1549] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:29.147249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf473-644b-4a14-9ae9-9bc3fd356026 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.148340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a0366084-b688-4bed-9cc2-e33dcf7dd15c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.150114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a0366084-b688-4bed-9cc2-e33dcf7dd15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.158592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf473-644b-4a14-9ae9-9bc3fd356026 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.161735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 770/1550] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.163059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf2074-bb22-4f0e-8cc6-6eb7fe24cdea None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.165668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf2074-bb22-4f0e-8cc6-6eb7fe24cdea None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.165668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf2074-bb22-4f0e-8cc6-6eb7fe24cdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.166393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a985d2-2fa2-469c-ae6d-4fb1b01c7671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.167026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a985d2-2fa2-469c-ae6d-4fb1b01c7671 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.167363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a985d2-2fa2-469c-ae6d-4fb1b01c7671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.167612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a985d2-2fa2-469c-ae6d-4fb1b01c7671 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.168875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a985d2-2fa2-469c-ae6d-4fb1b01c7671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.169186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a985d2-2fa2-469c-ae6d-4fb1b01c7671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.170389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING py.warnings [None req-94a985d2-2fa2-469c-ae6d-4fb1b01c7671 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:37:29.170389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: warnings.warn(msg) Aug 01 15:37:29.170389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: Aug 01 15:37:29.171291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a985d2-2fa2-469c-ae6d-4fb1b01c7671 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.185394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cbcf2074-bb22-4f0e-8cc6-6eb7fe24cdea None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.186183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 781/1551] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.191027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cbcf2074-bb22-4f0e-8cc6-6eb7fe24cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.191210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc7e0-adb9-427d-89a6-eb305f67ac2f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.191210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc7e0-adb9-427d-89a6-eb305f67ac2f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.191210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc7e0-adb9-427d-89a6-eb305f67ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.206490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 771/1552] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.208649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f7710-8efd-4022-82ae-8d02fff63308 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.209197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f7710-8efd-4022-82ae-8d02fff63308 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.209641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f7710-8efd-4022-82ae-8d02fff63308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.223438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-82efc7e0-adb9-427d-89a6-eb305f67ac2f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.225193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-82efc7e0-adb9-427d-89a6-eb305f67ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.236264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 782/1553] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.237337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d7f03-664a-4acc-9915-58d77db3b859 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.237622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d7f03-664a-4acc-9915-58d77db3b859 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.237950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d7f03-664a-4acc-9915-58d77db3b859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.241833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-512f7710-8efd-4022-82ae-8d02fff63308 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.243093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-512f7710-8efd-4022-82ae-8d02fff63308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.253083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 772/1554] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.254234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f7710-8efd-4022-82ae-8d02fff63308 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.257575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-aa0d7f03-664a-4acc-9915-58d77db3b859 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.258755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-aa0d7f03-664a-4acc-9915-58d77db3b859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.265130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f7710-8efd-4022-82ae-8d02fff63308 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.266722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 783/1555] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.267886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d7f03-664a-4acc-9915-58d77db3b859 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.270057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc035b-2d83-4a02-873d-46179ae1b46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.270673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc035b-2d83-4a02-873d-46179ae1b46c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.270959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc035b-2d83-4a02-873d-46179ae1b46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.271235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc035b-2d83-4a02-873d-46179ae1b46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.272052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc035b-2d83-4a02-873d-46179ae1b46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.274492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc035b-2d83-4a02-873d-46179ae1b46c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.278793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d7f03-664a-4acc-9915-58d77db3b859 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.283778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a864fe-0b80-4337-a653-d2b7fef17d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.284409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a864fe-0b80-4337-a653-d2b7fef17d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.284747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a864fe-0b80-4337-a653-d2b7fef17d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.285038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a864fe-0b80-4337-a653-d2b7fef17d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.285769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a864fe-0b80-4337-a653-d2b7fef17d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.285890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 773/1556] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:29.286149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a864fe-0b80-4337-a653-d2b7fef17d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.288116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a864fe-0b80-4337-a653-d2b7fef17d1e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.289701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc035b-2d83-4a02-873d-46179ae1b46c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.300070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc035b-2d83-4a02-873d-46179ae1b46c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.301546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 784/1557] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.302812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c40d3d-17fb-4476-a93b-983f5868589c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.303105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c40d3d-17fb-4476-a93b-983f5868589c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.303401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c40d3d-17fb-4476-a93b-983f5868589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.311014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.311676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.311947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.312216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.312961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.313914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:37:29.313914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: warnings.warn(msg) Aug 01 15:37:29.313914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: Aug 01 15:37:29.315184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.327482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b4c40d3d-17fb-4476-a93b-983f5868589c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.328699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b4c40d3d-17fb-4476-a93b-983f5868589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.337919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 785/1558] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.339561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674779-e94b-4cc0-a418-ed724cf29298 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.339856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674779-e94b-4cc0-a418-ed724cf29298 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.340642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674779-e94b-4cc0-a418-ed724cf29298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.351445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 774/1559] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:29.352133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.366169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6f674779-e94b-4cc0-a418-ed724cf29298 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.367119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6f674779-e94b-4cc0-a418-ed724cf29298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.422852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f531fd-79b3-4626-8902-b4e410256585 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.423803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:29.428452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36623d69-cce6-46c3-9da3-299dc1ed8ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.429021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623d69-cce6-46c3-9da3-299dc1ed8ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.429303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623d69-cce6-46c3-9da3-299dc1ed8ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.429737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623d69-cce6-46c3-9da3-299dc1ed8ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.430442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36623d69-cce6-46c3-9da3-299dc1ed8ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.430760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36623d69-cce6-46c3-9da3-299dc1ed8ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.432417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36623d69-cce6-46c3-9da3-299dc1ed8ee6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.438788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 786/1560] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.440288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:29.440738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3eae-4e36-40f1-bd87-5ace0e8a6bef None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.441030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3eae-4e36-40f1-bd87-5ace0e8a6bef None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.441300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3eae-4e36-40f1-bd87-5ace0e8a6bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.457832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 775/1561] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.457832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4435-73cf-4172-9dc1-482b1eae6fb4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.457832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4435-73cf-4172-9dc1-482b1eae6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.457832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4435-73cf-4172-9dc1-482b1eae6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.462631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5b3d3eae-4e36-40f1-bd87-5ace0e8a6bef None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.463876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5b3d3eae-4e36-40f1-bd87-5ace0e8a6bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.473150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 787/1562] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.474013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d3eae-4e36-40f1-bd87-5ace0e8a6bef None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.478172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-922c4435-73cf-4172-9dc1-482b1eae6fb4 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.479695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-922c4435-73cf-4172-9dc1-482b1eae6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.484243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d3eae-4e36-40f1-bd87-5ace0e8a6bef None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.488880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60a536-b02b-4859-9dbd-14ed9b09181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.489387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 776/1563] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.489545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60a536-b02b-4859-9dbd-14ed9b09181d admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.489823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60a536-b02b-4859-9dbd-14ed9b09181d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.490097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60a536-b02b-4859-9dbd-14ed9b09181d admin admin] PATH_INFO: `/v3/projects/b8c601a28e8946f284afca9d3237adc6/users/eb98fec3c7394d889b77544ac52643b8/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.490494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4435-73cf-4172-9dc1-482b1eae6fb4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.503107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4435-73cf-4172-9dc1-482b1eae6fb4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.507915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60a536-b02b-4859-9dbd-14ed9b09181d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c601a28e8946f284afca9d3237adc6, user_id=eb98fec3c7394d889b77544ac52643b8, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.508075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7818fc-56c5-4811-b325-9657d0dbf936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.508804 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7818fc-56c5-4811-b325-9657d0dbf936 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.509000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7818fc-56c5-4811-b325-9657d0dbf936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.509282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7818fc-56c5-4811-b325-9657d0dbf936 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.509955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7818fc-56c5-4811-b325-9657d0dbf936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.510660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60a536-b02b-4859-9dbd-14ed9b09181d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.512415 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7818fc-56c5-4811-b325-9657d0dbf936 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.524932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 788/1564] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:29 2022] PUT /identity/v3/projects/b8c601a28e8946f284afca9d3237adc6/users/eb98fec3c7394d889b77544ac52643b8/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:29.526428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112d5d-353a-44c1-8926-2a39e130c22f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.526713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112d5d-353a-44c1-8926-2a39e130c22f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.526991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112d5d-353a-44c1-8926-2a39e130c22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.541602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 777/1565] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:29.542493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7818fc-56c5-4811-b325-9657d0dbf936 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.550847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-99112d5d-353a-44c1-8926-2a39e130c22f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.552094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-99112d5d-353a-44c1-8926-2a39e130c22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.608992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7818fc-56c5-4811-b325-9657d0dbf936 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.614136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02c301-0c40-48f7-ba03-80d1c5838974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.614832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c301-0c40-48f7-ba03-80d1c5838974 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.615117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c301-0c40-48f7-ba03-80d1c5838974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.615448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c301-0c40-48f7-ba03-80d1c5838974 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.616483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02c301-0c40-48f7-ba03-80d1c5838974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.618420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02c301-0c40-48f7-ba03-80d1c5838974 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.618736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 789/1566] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.619626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99112d5d-353a-44c1-8926-2a39e130c22f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.629245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99112d5d-353a-44c1-8926-2a39e130c22f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.635086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.635912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.636321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.636678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.637918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.638225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.639858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.643233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 778/1567] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:29.644008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02c301-0c40-48f7-ba03-80d1c5838974 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.653087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 790/1568] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.653922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.657005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02c301-0c40-48f7-ba03-80d1c5838974 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.663984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96cf11-3d80-49e6-8f23-bee8de637d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.664616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96cf11-3d80-49e6-8f23-bee8de637d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.664901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96cf11-3d80-49e6-8f23-bee8de637d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.665176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96cf11-3d80-49e6-8f23-bee8de637d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.665851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96cf11-3d80-49e6-8f23-bee8de637d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.667801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96cf11-3d80-49e6-8f23-bee8de637d7a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.670462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b04827-77e8-4db2-a9c9-9a771a56f203 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.677236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.677864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.678145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.678445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.679172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.679511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.681181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.694231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 791/1569] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.695107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.701058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 779/1570] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:29.701058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793554-a405-4a4b-8dae-056bf003d203 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.701058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793554-a405-4a4b-8dae-056bf003d203 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.701058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793554-a405-4a4b-8dae-056bf003d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.707997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20901cb2-20e1-4e72-bbf6-9fac049e42ac admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.721125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-74793554-a405-4a4b-8dae-056bf003d203 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.722345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-74793554-a405-4a4b-8dae-056bf003d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.770957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.771993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.772453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.773075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.774260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.774782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.778167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.795592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 792/1571] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.803340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 780/1572] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:29.803340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793554-a405-4a4b-8dae-056bf003d203 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.809206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.817149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793554-a405-4a4b-8dae-056bf003d203 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.820908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7fe20-a670-4f2e-95c3-c4f76ba08e20 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.822082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.822776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.823076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.823467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.824176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.825115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.826751 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.827020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.827730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.828015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.828294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.828965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.829994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING py.warnings [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:37:29.829994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: warnings.warn(msg) Aug 01 15:37:29.829994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: Aug 01 15:37:29.831202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.839253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 781/1573] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.839981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.850591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1acb8-ce52-4acf-b05d-559629840a15 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.855356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16609b-b2d2-4cb9-84ab-7211effa2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.856030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16609b-b2d2-4cb9-84ab-7211effa2a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.856307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16609b-b2d2-4cb9-84ab-7211effa2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.856581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16609b-b2d2-4cb9-84ab-7211effa2a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.857315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16609b-b2d2-4cb9-84ab-7211effa2a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.859190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16609b-b2d2-4cb9-84ab-7211effa2a11 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.859350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 793/1574] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/users => generated 297 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:29.860054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.870639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 782/1575] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:29.872096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16609b-b2d2-4cb9-84ab-7211effa2a11 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.876323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b2fbf-8bc8-41a5-99f4-9027ae71db19 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.883361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16609b-b2d2-4cb9-84ab-7211effa2a11 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.883659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba27042-d215-48b9-860b-e4e27f05fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.884438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba27042-d215-48b9-860b-e4e27f05fe32 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.884893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba27042-d215-48b9-860b-e4e27f05fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.885366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba27042-d215-48b9-860b-e4e27f05fe32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.886268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba27042-d215-48b9-860b-e4e27f05fe32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.889225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe749c-a4a5-49c1-82e5-82f648bc25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.889508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba27042-d215-48b9-860b-e4e27f05fe32 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.889998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe749c-a4a5-49c1-82e5-82f648bc25d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.890234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe749c-a4a5-49c1-82e5-82f648bc25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.890514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe749c-a4a5-49c1-82e5-82f648bc25d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.891174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe749c-a4a5-49c1-82e5-82f648bc25d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.893381 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe749c-a4a5-49c1-82e5-82f648bc25d9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.908261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:29.915579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:29.925384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 783/1576] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:29.926137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe749c-a4a5-49c1-82e5-82f648bc25d9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.927770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 794/1577] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:29.928527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba27042-d215-48b9-860b-e4e27f05fe32 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.019347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe749c-a4a5-49c1-82e5-82f648bc25d9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.028480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd4c69-48ae-43b3-9f91-991ac05bb3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.029137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4c69-48ae-43b3-9f91-991ac05bb3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.029409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4c69-48ae-43b3-9f91-991ac05bb3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.029701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4c69-48ae-43b3-9f91-991ac05bb3fd admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.030512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd4c69-48ae-43b3-9f91-991ac05bb3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.032863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd4c69-48ae-43b3-9f91-991ac05bb3fd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.035226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba27042-d215-48b9-860b-e4e27f05fe32 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.045132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459daf86-7f38-4713-996d-3fff0d375400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.046070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459daf86-7f38-4713-996d-3fff0d375400 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.046455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459daf86-7f38-4713-996d-3fff0d375400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.047005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459daf86-7f38-4713-996d-3fff0d375400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.048082 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459daf86-7f38-4713-996d-3fff0d375400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.050956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459daf86-7f38-4713-996d-3fff0d375400 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.061750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 784/1578] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:30.062021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd4c69-48ae-43b3-9f91-991ac05bb3fd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.099902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 795/1579] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:30.100908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459daf86-7f38-4713-996d-3fff0d375400 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.167035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd4c69-48ae-43b3-9f91-991ac05bb3fd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.196552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459daf86-7f38-4713-996d-3fff0d375400 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.202113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46b7dc-3393-43b8-95af-7037f30bda83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.202752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46b7dc-3393-43b8-95af-7037f30bda83 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.203361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46b7dc-3393-43b8-95af-7037f30bda83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.203361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46b7dc-3393-43b8-95af-7037f30bda83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.204005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46b7dc-3393-43b8-95af-7037f30bda83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.205990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46b7dc-3393-43b8-95af-7037f30bda83 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.244831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 796/1580] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:30 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:30.245830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46b7dc-3393-43b8-95af-7037f30bda83 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.250724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f2414-4134-4696-ab7c-47b39c4c344d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.251547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f2414-4134-4696-ab7c-47b39c4c344d service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.251832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f2414-4134-4696-ab7c-47b39c4c344d service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.252111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f2414-4134-4696-ab7c-47b39c4c344d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.261608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f2414-4134-4696-ab7c-47b39c4c344d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.263091 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f2414-4134-4696-ab7c-47b39c4c344d service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.273344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 785/1581] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:30.274187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f2414-4134-4696-ab7c-47b39c4c344d service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.284593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f2414-4134-4696-ab7c-47b39c4c344d service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.336283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46b7dc-3393-43b8-95af-7037f30bda83 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.341600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ac888-dd16-4e80-9651-a9b2efe7aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.342596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ac888-dd16-4e80-9651-a9b2efe7aaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.342596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ac888-dd16-4e80-9651-a9b2efe7aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.342927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ac888-dd16-4e80-9651-a9b2efe7aaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.344011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ac888-dd16-4e80-9651-a9b2efe7aaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.346619 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:30.347653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ac888-dd16-4e80-9651-a9b2efe7aaa4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.374575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 797/1582] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.374575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ac888-dd16-4e80-9651-a9b2efe7aaa4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.386819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:30.389167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2337d-59de-4918-a65a-6f814a4d2df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.389813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2337d-59de-4918-a65a-6f814a4d2df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.390291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2337d-59de-4918-a65a-6f814a4d2df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.390574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2337d-59de-4918-a65a-6f814a4d2df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.391037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ac888-dd16-4e80-9651-a9b2efe7aaa4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.391307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2337d-59de-4918-a65a-6f814a4d2df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.393239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2337d-59de-4918-a65a-6f814a4d2df3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.401302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046d6c5-b4cc-4f74-97b9-208d342fbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.403523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046d6c5-b4cc-4f74-97b9-208d342fbea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.404012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046d6c5-b4cc-4f74-97b9-208d342fbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.404644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046d6c5-b4cc-4f74-97b9-208d342fbea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.405913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046d6c5-b4cc-4f74-97b9-208d342fbea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.408383 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 786/1583] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.409468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2337d-59de-4918-a65a-6f814a4d2df3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.412273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046d6c5-b4cc-4f74-97b9-208d342fbea7 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.422752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2337d-59de-4918-a65a-6f814a4d2df3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.429312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ff29c-0725-4588-85c2-7cf9cf646bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.430117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ff29c-0725-4588-85c2-7cf9cf646bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.430303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ff29c-0725-4588-85c2-7cf9cf646bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.430535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ff29c-0725-4588-85c2-7cf9cf646bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.431144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ff29c-0725-4588-85c2-7cf9cf646bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.433418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ff29c-0725-4588-85c2-7cf9cf646bb4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.451794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 798/1584] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:30 2022] POST /identity/v3/users => generated 295 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:30.452873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046d6c5-b4cc-4f74-97b9-208d342fbea7 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.465700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 787/1585] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:30 2022] POST /identity/v3/users => generated 278 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:30.465700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ff29c-0725-4588-85c2-7cf9cf646bb4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.468270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046d6c5-b4cc-4f74-97b9-208d342fbea7 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.478285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ff29c-0725-4588-85c2-7cf9cf646bb4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.488214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee0fee-5e23-41d4-9fa2-839d3bea13b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.489747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0fee-5e23-41d4-9fa2-839d3bea13b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.490251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0fee-5e23-41d4-9fa2-839d3bea13b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.490874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0fee-5e23-41d4-9fa2-839d3bea13b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.491999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee0fee-5e23-41d4-9fa2-839d3bea13b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.492209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa82ee-431d-4f6c-a873-52d49805fe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.494080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa82ee-431d-4f6c-a873-52d49805fe16 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.494543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa82ee-431d-4f6c-a873-52d49805fe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.494964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee0fee-5e23-41d4-9fa2-839d3bea13b4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.495129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa82ee-431d-4f6c-a873-52d49805fe16 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.497816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa82ee-431d-4f6c-a873-52d49805fe16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.501648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa82ee-431d-4f6c-a873-52d49805fe16 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.518609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 799/1586] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.518609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee0fee-5e23-41d4-9fa2-839d3bea13b4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.533500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee0fee-5e23-41d4-9fa2-839d3bea13b4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.539504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 788/1587] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:30 2022] POST /identity/v3/users => generated 292 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:30.539504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa82ee-431d-4f6c-a873-52d49805fe16 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.542788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b222f2-d4f1-49b4-a216-48bc033c5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.544112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b222f2-d4f1-49b4-a216-48bc033c5b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.544400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b222f2-d4f1-49b4-a216-48bc033c5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.544677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b222f2-d4f1-49b4-a216-48bc033c5b36 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.545398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b222f2-d4f1-49b4-a216-48bc033c5b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.548198 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b222f2-d4f1-49b4-a216-48bc033c5b36 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.559366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa82ee-431d-4f6c-a873-52d49805fe16 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.566981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b78af0-1563-4d43-b5be-11214a5dfa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.567692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b78af0-1563-4d43-b5be-11214a5dfa70 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.568008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b78af0-1563-4d43-b5be-11214a5dfa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.568290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b78af0-1563-4d43-b5be-11214a5dfa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.568999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b78af0-1563-4d43-b5be-11214a5dfa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.570925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b78af0-1563-4d43-b5be-11214a5dfa70 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.582542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 789/1589] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.582829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 800/1589] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:30 2022] POST /identity/v3/users => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:30.583412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b78af0-1563-4d43-b5be-11214a5dfa70 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.586280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b222f2-d4f1-49b4-a216-48bc033c5b36 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.597313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b78af0-1563-4d43-b5be-11214a5dfa70 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.602747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.604069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.604366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.604651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] PATH_INFO: `/v3/projects/f0713d3cbec94c3b8487e9cb7cd21a8a/users/277c3debf6ec4c85a223503a5c7ed241/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.607202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b222f2-d4f1-49b4-a216-48bc033c5b36 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.615601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d025f-921a-4481-91ae-18a9dd53ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.616883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d025f-921a-4481-91ae-18a9dd53ec04 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.617569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d025f-921a-4481-91ae-18a9dd53ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.618218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d025f-921a-4481-91ae-18a9dd53ec04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.619705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d025f-921a-4481-91ae-18a9dd53ec04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.623001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d025f-921a-4481-91ae-18a9dd53ec04 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.624899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0713d3cbec94c3b8487e9cb7cd21a8a, user_id=277c3debf6ec4c85a223503a5c7ed241, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.626214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:37:30.626214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: warnings.warn(msg) Aug 01 15:37:30.626214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: Aug 01 15:37:30.628603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.643933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 790/1590] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:30 2022] PUT /identity/v3/projects/f0713d3cbec94c3b8487e9cb7cd21a8a/users/277c3debf6ec4c85a223503a5c7ed241/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:30.644547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.645103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 801/1591] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.646782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d025f-921a-4481-91ae-18a9dd53ec04 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.666630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d025f-921a-4481-91ae-18a9dd53ec04 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.715492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b0fe-0855-4c40-bffb-405d6f674f7a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.721439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e00913-0b9b-44a6-98ac-27e31fbfde1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.722177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e00913-0b9b-44a6-98ac-27e31fbfde1d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.722488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e00913-0b9b-44a6-98ac-27e31fbfde1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.722786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e00913-0b9b-44a6-98ac-27e31fbfde1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.723589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e00913-0b9b-44a6-98ac-27e31fbfde1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.725209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e00913-0b9b-44a6-98ac-27e31fbfde1d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.737168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 791/1592] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.737974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e00913-0b9b-44a6-98ac-27e31fbfde1d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.751419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e00913-0b9b-44a6-98ac-27e31fbfde1d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.756742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989e63e-bdde-4fe6-a0e7-514ee270644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.757380 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e63e-bdde-4fe6-a0e7-514ee270644a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.757838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e63e-bdde-4fe6-a0e7-514ee270644a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.758126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e63e-bdde-4fe6-a0e7-514ee270644a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.758843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989e63e-bdde-4fe6-a0e7-514ee270644a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.760488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989e63e-bdde-4fe6-a0e7-514ee270644a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.761548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96054-9e34-4d17-bbad-d96fea77bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.761716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96054-9e34-4d17-bbad-d96fea77bb1f admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.762701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96054-9e34-4d17-bbad-d96fea77bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.763077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96054-9e34-4d17-bbad-d96fea77bb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.764411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96054-9e34-4d17-bbad-d96fea77bb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.766145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96054-9e34-4d17-bbad-d96fea77bb1f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.773247 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 792/1593] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.777164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989e63e-bdde-4fe6-a0e7-514ee270644a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.777722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 802/1594] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.778590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96054-9e34-4d17-bbad-d96fea77bb1f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.791581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96054-9e34-4d17-bbad-d96fea77bb1f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.795548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989e63e-bdde-4fe6-a0e7-514ee270644a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.796960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ac08-5503-497a-bc44-4c290f888562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.797988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ac08-5503-497a-bc44-4c290f888562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.798615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ac08-5503-497a-bc44-4c290f888562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.799362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ac08-5503-497a-bc44-4c290f888562 admin admin] PATH_INFO: `/v3/projects/4c16b412daae41abb63339c224d44206/users/e4a4c21d432448fcbb75e000741d5dc4/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.801924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6206f73-ea1f-4df1-9937-970c487730d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.802679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6206f73-ea1f-4df1-9937-970c487730d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.803045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6206f73-ea1f-4df1-9937-970c487730d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.803570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6206f73-ea1f-4df1-9937-970c487730d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.804145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6206f73-ea1f-4df1-9937-970c487730d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.805895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6206f73-ea1f-4df1-9937-970c487730d2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.820050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 793/1595] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.820575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27ac08-5503-497a-bc44-4c290f888562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c16b412daae41abb63339c224d44206, user_id=e4a4c21d432448fcbb75e000741d5dc4, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.820996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6206f73-ea1f-4df1-9937-970c487730d2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.823816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27ac08-5503-497a-bc44-4c290f888562 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.833481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6206f73-ea1f-4df1-9937-970c487730d2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.839055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c4d2b-7e89-41a4-9ffc-1e0b9a7275a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.839746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c4d2b-7e89-41a4-9ffc-1e0b9a7275a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.840062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c4d2b-7e89-41a4-9ffc-1e0b9a7275a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.840384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c4d2b-7e89-41a4-9ffc-1e0b9a7275a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.841103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c4d2b-7e89-41a4-9ffc-1e0b9a7275a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.842971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c4d2b-7e89-41a4-9ffc-1e0b9a7275a7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.843779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 803/1596] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:30 2022] PUT /identity/v3/projects/4c16b412daae41abb63339c224d44206/users/e4a4c21d432448fcbb75e000741d5dc4/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:30.845427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cffff5-c62c-4f63-81b0-61c79bdaf699 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.846105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cffff5-c62c-4f63-81b0-61c79bdaf699 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.846661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cffff5-c62c-4f63-81b0-61c79bdaf699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.855345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 794/1597] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.856419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c4d2b-7e89-41a4-9ffc-1e0b9a7275a7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.873350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c4d2b-7e89-41a4-9ffc-1e0b9a7275a7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.885602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-16cffff5-c62c-4f63-81b0-61c79bdaf699 None None] MFA Rules not processed for user `277c3debf6ec4c85a223503a5c7ed241`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:30.887555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-16cffff5-c62c-4f63-81b0-61c79bdaf699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:30.906328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:30.943653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115c090-e03b-4a16-a349-8ef0195de61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.944832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115c090-e03b-4a16-a349-8ef0195de61c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.944832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115c090-e03b-4a16-a349-8ef0195de61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.944832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115c090-e03b-4a16-a349-8ef0195de61c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.945540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115c090-e03b-4a16-a349-8ef0195de61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.947162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115c090-e03b-4a16-a349-8ef0195de61c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.959158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 795/1598] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:30.960079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115c090-e03b-4a16-a349-8ef0195de61c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.975811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115c090-e03b-4a16-a349-8ef0195de61c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.981454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597e7c0-dedf-4b43-8b59-bbc101cbb73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.982019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e7c0-dedf-4b43-8b59-bbc101cbb73d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.982297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e7c0-dedf-4b43-8b59-bbc101cbb73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.982719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e7c0-dedf-4b43-8b59-bbc101cbb73d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.983439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597e7c0-dedf-4b43-8b59-bbc101cbb73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.985076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597e7c0-dedf-4b43-8b59-bbc101cbb73d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.000857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 796/1599] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:31.000857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597e7c0-dedf-4b43-8b59-bbc101cbb73d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:31.010245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 804/1600] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:31.010245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cffff5-c62c-4f63-81b0-61c79bdaf699 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:31.015836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597e7c0-dedf-4b43-8b59-bbc101cbb73d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:31.021724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cffff5-c62c-4f63-81b0-61c79bdaf699 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:31.023037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6da68e-0461-41b4-8f8a-07e5ce6a5c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:31.023795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6da68e-0461-41b4-8f8a-07e5ce6a5c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.023994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6da68e-0461-41b4-8f8a-07e5ce6a5c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.024400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6da68e-0461-41b4-8f8a-07e5ce6a5c56 admin admin] PATH_INFO: `/v3/projects/a42305fb9594459086839013d9da08d7/users/e538fef072d14a41bf1fc9d635b2feed/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.026953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6dd79-a98d-48b0-a55a-988245f521f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:31.029620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6dd79-a98d-48b0-a55a-988245f521f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.029620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6dd79-a98d-48b0-a55a-988245f521f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.029620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6dd79-a98d-48b0-a55a-988245f521f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.029620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6dd79-a98d-48b0-a55a-988245f521f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:31.030933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6dd79-a98d-48b0-a55a-988245f521f8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.037383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:31.049695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6da68e-0461-41b4-8f8a-07e5ce6a5c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42305fb9594459086839013d9da08d7, user_id=e538fef072d14a41bf1fc9d635b2feed, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:31.052948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6da68e-0461-41b4-8f8a-07e5ce6a5c56 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.059555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 805/1601] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:31.061725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea700fbb-54a6-4fad-9594-60d9c865e855 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.062492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea700fbb-54a6-4fad-9594-60d9c865e855 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.063041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea700fbb-54a6-4fad-9594-60d9c865e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.083685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 797/1602] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:30 2022] PUT /identity/v3/projects/a42305fb9594459086839013d9da08d7/users/e538fef072d14a41bf1fc9d635b2feed/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:31.087869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6da68e-0461-41b4-8f8a-07e5ce6a5c56 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:31.100266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ea700fbb-54a6-4fad-9594-60d9c865e855 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:31.103191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ea700fbb-54a6-4fad-9594-60d9c865e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.189989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 806/1603] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:31.190784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea700fbb-54a6-4fad-9594-60d9c865e855 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:31.204340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea700fbb-54a6-4fad-9594-60d9c865e855 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:31.206525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6da68e-0461-41b4-8f8a-07e5ce6a5c56 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:31.209467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6032-6c68-4f80-b16e-282f5d453ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:31.210631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6032-6c68-4f80-b16e-282f5d453ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.210917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6032-6c68-4f80-b16e-282f5d453ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.211203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6032-6c68-4f80-b16e-282f5d453ddb admin admin] PATH_INFO: `/v3/projects/5e56c7c0b3ef4ce5a68d3f71ae5608d8/users/6308f2c629ec43cbbbe342bbc02cf74b/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.213025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cca1fe-30c4-42a3-a221-9ee286757f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:31.214313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca1fe-30c4-42a3-a221-9ee286757f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.215701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca1fe-30c4-42a3-a221-9ee286757f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.215991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca1fe-30c4-42a3-a221-9ee286757f62 admin admin] PATH_INFO: `/v3/projects/77cd3a50f7084a70a205159c761bae1d/users/de3ad14b526247d5b60dc22b88b56255/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.230200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c6032-6c68-4f80-b16e-282f5d453ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e56c7c0b3ef4ce5a68d3f71ae5608d8, user_id=6308f2c629ec43cbbbe342bbc02cf74b, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:31.233431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c6032-6c68-4f80-b16e-282f5d453ddb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.235984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cca1fe-30c4-42a3-a221-9ee286757f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cd3a50f7084a70a205159c761bae1d, user_id=de3ad14b526247d5b60dc22b88b56255, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:31.239149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cca1fe-30c4-42a3-a221-9ee286757f62 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.251961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 807/1604] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:31 2022] PUT /identity/v3/projects/5e56c7c0b3ef4ce5a68d3f71ae5608d8/users/6308f2c629ec43cbbbe342bbc02cf74b/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:31.253276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6032-6c68-4f80-b16e-282f5d453ddb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:31.269344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 798/1605] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:31 2022] PUT /identity/v3/projects/77cd3a50f7084a70a205159c761bae1d/users/de3ad14b526247d5b60dc22b88b56255/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:31.274401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd890da4-aae3-4182-8f02-993f5abaae35 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.275087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd890da4-aae3-4182-8f02-993f5abaae35 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.275087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd890da4-aae3-4182-8f02-993f5abaae35 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.277442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 799/1606] 10.222.0.71 () {54 vars in 962 bytes} [Mon Aug 1 15:37:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:31.278092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd890da4-aae3-4182-8f02-993f5abaae35 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:31.369770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd890da4-aae3-4182-8f02-993f5abaae35 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:31.376295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520abb3-3fdb-4046-9eb9-8a16749146f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:31.377188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520abb3-3fdb-4046-9eb9-8a16749146f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.377477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520abb3-3fdb-4046-9eb9-8a16749146f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.377896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520abb3-3fdb-4046-9eb9-8a16749146f2 admin admin] PATH_INFO: `/v3/projects/30d4d43d5dcf460ab869785d343ca803/users/f4fa2b7534d0498f9e30c382e640c878/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.383998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6032-6c68-4f80-b16e-282f5d453ddb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:31.393742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:31.395233 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.396284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.396643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] PATH_INFO: `/v3/projects/dd50ab9197794a99be717b51f8778b68/users/b325a118b0964730ada2630cd2b47fb4/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.397791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520abb3-3fdb-4046-9eb9-8a16749146f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d4d43d5dcf460ab869785d343ca803, user_id=f4fa2b7534d0498f9e30c382e640c878, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:31.400739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520abb3-3fdb-4046-9eb9-8a16749146f2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.406144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:31.423140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 800/1607] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:31 2022] PUT /identity/v3/projects/30d4d43d5dcf460ab869785d343ca803/users/f4fa2b7534d0498f9e30c382e640c878/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:31.424878 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942052fb-5285-4b8d-95c7-e1f09903cdf8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.425079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd50ab9197794a99be717b51f8778b68, user_id=b325a118b0964730ada2630cd2b47fb4, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:31.425245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942052fb-5285-4b8d-95c7-e1f09903cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.425570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942052fb-5285-4b8d-95c7-e1f09903cdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.428721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.454352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 808/1608] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:31 2022] PUT /identity/v3/projects/dd50ab9197794a99be717b51f8778b68/users/b325a118b0964730ada2630cd2b47fb4/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:31.455620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:31.457421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.484959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-942052fb-5285-4b8d-95c7-e1f09903cdf8 None None] MFA Rules not processed for user `e538fef072d14a41bf1fc9d635b2feed`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:31.486132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-942052fb-5285-4b8d-95c7-e1f09903cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.546799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bedd3-d41b-4c6e-bd6a-ae01f2c0c92a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:31.553956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd97e-d8cc-4fe5-b520-64356b8ed323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:31.555025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd97e-d8cc-4fe5-b520-64356b8ed323 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.555402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd97e-d8cc-4fe5-b520-64356b8ed323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.555786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd97e-d8cc-4fe5-b520-64356b8ed323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.579403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:31.644438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 801/1609] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:31.647754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa78dd-f451-416b-8dd3-90868135a3c7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.648239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa78dd-f451-416b-8dd3-90868135a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.648724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa78dd-f451-416b-8dd3-90868135a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.689016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1eaa78dd-f451-416b-8dd3-90868135a3c7 None None] MFA Rules not processed for user `6308f2c629ec43cbbbe342bbc02cf74b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:31.690527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1eaa78dd-f451-416b-8dd3-90868135a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.721146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afd97e-d8cc-4fe5-b520-64356b8ed323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:31.724878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afd97e-d8cc-4fe5-b520-64356b8ed323 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.752666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 809/1610] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:31.754344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd24c-999d-4021-b339-8acc16b901bb None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.755215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd24c-999d-4021-b339-8acc16b901bb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.755519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd24c-999d-4021-b339-8acc16b901bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.786469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-868cd24c-999d-4021-b339-8acc16b901bb None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:31.789210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-868cd24c-999d-4021-b339-8acc16b901bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.814218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 810/1611] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:31.825923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79bd91-f8c4-462a-9fe7-de6db18964bd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.826250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79bd91-f8c4-462a-9fe7-de6db18964bd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.826730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79bd91-f8c4-462a-9fe7-de6db18964bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.876555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 802/1612] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:31.876555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108735-ecae-435c-88c6-0fff4cd8fc99 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.876555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108735-ecae-435c-88c6-0fff4cd8fc99 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.876555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108735-ecae-435c-88c6-0fff4cd8fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.911913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-15108735-ecae-435c-88c6-0fff4cd8fc99 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:31.915812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-15108735-ecae-435c-88c6-0fff4cd8fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.916092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8d79bd91-f8c4-462a-9fe7-de6db18964bd None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:31.917051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8d79bd91-f8c4-462a-9fe7-de6db18964bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.945167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 803/1613] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:31.947675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b08c-9a66-49b7-a873-99987a2d67d5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.947991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b08c-9a66-49b7-a873-99987a2d67d5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.948271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b08c-9a66-49b7-a873-99987a2d67d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.993687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3bd3b08c-9a66-49b7-a873-99987a2d67d5 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:31.995010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3bd3b08c-9a66-49b7-a873-99987a2d67d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:32.015841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 804/1614] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:32.017789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b08c-9a66-49b7-a873-99987a2d67d5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.038718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b08c-9a66-49b7-a873-99987a2d67d5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.052723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe029a-2133-42c9-b425-5b05ac10a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.053595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 811/1615] 10.222.0.71 () {58 vars in 1059 bytes} [Mon Aug 1 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:32.054607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79bd91-f8c4-462a-9fe7-de6db18964bd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.055616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe029a-2133-42c9-b425-5b05ac10a437 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.055912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe029a-2133-42c9-b425-5b05ac10a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.056192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe029a-2133-42c9-b425-5b05ac10a437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.056878 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe029a-2133-42c9-b425-5b05ac10a437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.061122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe029a-2133-42c9-b425-5b05ac10a437 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.069153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79bd91-f8c4-462a-9fe7-de6db18964bd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.076596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3115a7-508b-49c6-a5c3-01280d9f4588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.077392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3115a7-508b-49c6-a5c3-01280d9f4588 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.077875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3115a7-508b-49c6-a5c3-01280d9f4588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.078300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3115a7-508b-49c6-a5c3-01280d9f4588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.079202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3115a7-508b-49c6-a5c3-01280d9f4588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.081916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3115a7-508b-49c6-a5c3-01280d9f4588 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.139830 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 805/1616] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:32 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:32.145824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe029a-2133-42c9-b425-5b05ac10a437 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.147627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 812/1617] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:32 2022] POST /identity/v3/projects => generated 353 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:32.148663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3115a7-508b-49c6-a5c3-01280d9f4588 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.257177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:32.290348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe029a-2133-42c9-b425-5b05ac10a437 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.303731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3bee-16e5-4fae-9c55-27b590c98c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.304389 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3bee-16e5-4fae-9c55-27b590c98c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.304673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3bee-16e5-4fae-9c55-27b590c98c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.304955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3bee-16e5-4fae-9c55-27b590c98c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.328845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3115a7-508b-49c6-a5c3-01280d9f4588 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.335597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ab057-a7c6-49b5-8123-3a1637b07921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.336307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab057-a7c6-49b5-8123-3a1637b07921 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.336645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab057-a7c6-49b5-8123-3a1637b07921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.337080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab057-a7c6-49b5-8123-3a1637b07921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.352215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:32.476237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ab057-a7c6-49b5-8123-3a1637b07921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.476563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3bee-16e5-4fae-9c55-27b590c98c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.477918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3bee-16e5-4fae-9c55-27b590c98c12 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.478464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ab057-a7c6-49b5-8123-3a1637b07921 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.492261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 806/1618] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:32.493677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3bee-16e5-4fae-9c55-27b590c98c12 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.499447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 813/1619] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:32.500709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ab057-a7c6-49b5-8123-3a1637b07921 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.504664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3bee-16e5-4fae-9c55-27b590c98c12 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.509048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03e0b-1467-48c8-9184-8af7255f77ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.509695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03e0b-1467-48c8-9184-8af7255f77ed service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.510190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03e0b-1467-48c8-9184-8af7255f77ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.510521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03e0b-1467-48c8-9184-8af7255f77ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.524268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03e0b-1467-48c8-9184-8af7255f77ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.525696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03e0b-1467-48c8-9184-8af7255f77ed service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.537557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 807/1620] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:32.538419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03e0b-1467-48c8-9184-8af7255f77ed service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.550654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03e0b-1467-48c8-9184-8af7255f77ed service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.557914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b14fb-cd75-4190-bd95-6f2b30c63811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.558564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b14fb-cd75-4190-bd95-6f2b30c63811 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.559455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b14fb-cd75-4190-bd95-6f2b30c63811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.560085 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b14fb-cd75-4190-bd95-6f2b30c63811 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.560432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b14fb-cd75-4190-bd95-6f2b30c63811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.563352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b14fb-cd75-4190-bd95-6f2b30c63811 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.604379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 808/1621] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:32 2022] POST /identity/v3/users => generated 290 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:32.606539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b14fb-cd75-4190-bd95-6f2b30c63811 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.624963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ab057-a7c6-49b5-8123-3a1637b07921 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.626221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b14fb-cd75-4190-bd95-6f2b30c63811 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.633068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006f46-19da-455a-9f2b-cc8dce0a64f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.633933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006f46-19da-455a-9f2b-cc8dce0a64f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.634409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006f46-19da-455a-9f2b-cc8dce0a64f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.634773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006f46-19da-455a-9f2b-cc8dce0a64f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.635741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006f46-19da-455a-9f2b-cc8dce0a64f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.639976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006f46-19da-455a-9f2b-cc8dce0a64f3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.644866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019cf7-29e0-40ab-9cda-54b8476efbfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.646303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cf7-29e0-40ab-9cda-54b8476efbfb service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.646763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cf7-29e0-40ab-9cda-54b8476efbfb service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.647209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cf7-29e0-40ab-9cda-54b8476efbfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.725755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 809/1622] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:32 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:32.725755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006f46-19da-455a-9f2b-cc8dce0a64f3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.733558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006f46-19da-455a-9f2b-cc8dce0a64f3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.743710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86311387-c506-45fa-87be-dbd332871119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.744835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311387-c506-45fa-87be-dbd332871119 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.745471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311387-c506-45fa-87be-dbd332871119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.746235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311387-c506-45fa-87be-dbd332871119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.748230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86311387-c506-45fa-87be-dbd332871119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.750365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86311387-c506-45fa-87be-dbd332871119 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.780890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 810/1623] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:32.783536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86311387-c506-45fa-87be-dbd332871119 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.802612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019cf7-29e0-40ab-9cda-54b8476efbfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.805388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019cf7-29e0-40ab-9cda-54b8476efbfb service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.807245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86311387-c506-45fa-87be-dbd332871119 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.847680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 814/1624] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:32.849141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019cf7-29e0-40ab-9cda-54b8476efbfb service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.863041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a87b1-30e9-450e-b555-5aae05ed4513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.865990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a87b1-30e9-450e-b555-5aae05ed4513 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.868951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a87b1-30e9-450e-b555-5aae05ed4513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.870156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a87b1-30e9-450e-b555-5aae05ed4513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.876452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a87b1-30e9-450e-b555-5aae05ed4513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.880835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a87b1-30e9-450e-b555-5aae05ed4513 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.882058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019cf7-29e0-40ab-9cda-54b8476efbfb service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.901658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152e947-9c1f-454a-91db-53232d64dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.901658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152e947-9c1f-454a-91db-53232d64dfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.901658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152e947-9c1f-454a-91db-53232d64dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.902080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152e947-9c1f-454a-91db-53232d64dfcd admin admin] PATH_INFO: `/v3/projects/44848f7b35c748b3865162a425fd78be/users/76b15b3da59442ff964deec4222bb4c5/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.929179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 811/1625] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:32.930490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a87b1-30e9-450e-b555-5aae05ed4513 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.950925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152e947-9c1f-454a-91db-53232d64dfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=44848f7b35c748b3865162a425fd78be, user_id=76b15b3da59442ff964deec4222bb4c5, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.960316 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152e947-9c1f-454a-91db-53232d64dfcd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.960760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a87b1-30e9-450e-b555-5aae05ed4513 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.981868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477f52b-9492-4a97-bbd1-96e589892a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.985622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477f52b-9492-4a97-bbd1-96e589892a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.986033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477f52b-9492-4a97-bbd1-96e589892a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.986830 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477f52b-9492-4a97-bbd1-96e589892a81 admin admin] PATH_INFO: `/v3/projects/74cb547d63b14531b9aaada3cbf9157c/users/af63ec4abdc54dc1b852b8e2271bc6e4/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.000673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 815/1626] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:32 2022] PUT /identity/v3/projects/44848f7b35c748b3865162a425fd78be/users/76b15b3da59442ff964deec4222bb4c5/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:33.005139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152e947-9c1f-454a-91db-53232d64dfcd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:33.038566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477f52b-9492-4a97-bbd1-96e589892a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cb547d63b14531b9aaada3cbf9157c, user_id=af63ec4abdc54dc1b852b8e2271bc6e4, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:33.044009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477f52b-9492-4a97-bbd1-96e589892a81 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:33.062850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:33.083329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 812/1627] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:32 2022] PUT /identity/v3/projects/74cb547d63b14531b9aaada3cbf9157c/users/af63ec4abdc54dc1b852b8e2271bc6e4/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:33.088501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477f52b-9492-4a97-bbd1-96e589892a81 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:33.201052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152e947-9c1f-454a-91db-53232d64dfcd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:33.294630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:33.305433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477f52b-9492-4a97-bbd1-96e589892a81 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:33.320249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971db69a-b4d5-4c2b-bccc-7ffc2708dad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:33.322372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db69a-b4d5-4c2b-bccc-7ffc2708dad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.322661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db69a-b4d5-4c2b-bccc-7ffc2708dad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.322938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db69a-b4d5-4c2b-bccc-7ffc2708dad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.323677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db69a-b4d5-4c2b-bccc-7ffc2708dad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:33.330054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db69a-b4d5-4c2b-bccc-7ffc2708dad2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:33.356428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 813/1628] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:37:33.358361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702b43-17d7-4355-bf50-953512b7d903 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.358775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702b43-17d7-4355-bf50-953512b7d903 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.359056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702b43-17d7-4355-bf50-953512b7d903 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.360422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 814/1629] 10.222.0.71 () {54 vars in 912 bytes} [Mon Aug 1 15:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:33.375905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f702b43-17d7-4355-bf50-953512b7d903 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:33.384757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5f1b0-29cd-4062-a929-33992558bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:33.385747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f1b0-29cd-4062-a929-33992558bc08 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.388792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f1b0-29cd-4062-a929-33992558bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.389115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5f1b0-29cd-4062-a929-33992558bc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.389931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5f1b0-29cd-4062-a929-33992558bc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:33.394054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5f1b0-29cd-4062-a929-33992558bc08 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:33.416920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f702b43-17d7-4355-bf50-953512b7d903 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:33.424373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 816/1630] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:33.426095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4abf0-c41a-459b-8b41-347c7d01ac1a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.426607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4abf0-c41a-459b-8b41-347c7d01ac1a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.430245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4abf0-c41a-459b-8b41-347c7d01ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.431241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790bc0b-d19e-487a-86da-db72af2c505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:33.431894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790bc0b-d19e-487a-86da-db72af2c505b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.432169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790bc0b-d19e-487a-86da-db72af2c505b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.432441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790bc0b-d19e-487a-86da-db72af2c505b admin admin] PATH_INFO: `/v3/projects/74cb547d63b14531b9aaada3cbf9157c/users/af63ec4abdc54dc1b852b8e2271bc6e4/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.437362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790bc0b-d19e-487a-86da-db72af2c505b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cb547d63b14531b9aaada3cbf9157c, user_id=af63ec4abdc54dc1b852b8e2271bc6e4, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:33.444508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790bc0b-d19e-487a-86da-db72af2c505b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:33.487952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 815/1631] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:33 2022] PUT /identity/v3/projects/74cb547d63b14531b9aaada3cbf9157c/users/af63ec4abdc54dc1b852b8e2271bc6e4/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:33.488834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790bc0b-d19e-487a-86da-db72af2c505b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:33.495005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f0d4abf0-c41a-459b-8b41-347c7d01ac1a None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:33.496748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f0d4abf0-c41a-459b-8b41-347c7d01ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:33.696258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790bc0b-d19e-487a-86da-db72af2c505b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:33.707198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c4a9-fa5b-4d58-bce4-f5104e3b1569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:33.708379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c4a9-fa5b-4d58-bce4-f5104e3b1569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.708826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c4a9-fa5b-4d58-bce4-f5104e3b1569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.709602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c4a9-fa5b-4d58-bce4-f5104e3b1569 admin admin] PATH_INFO: `/v3/projects/44848f7b35c748b3865162a425fd78be/users/76b15b3da59442ff964deec4222bb4c5/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.714193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c4a9-fa5b-4d58-bce4-f5104e3b1569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44848f7b35c748b3865162a425fd78be, user_id=76b15b3da59442ff964deec4222bb4c5, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:33.719790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c4a9-fa5b-4d58-bce4-f5104e3b1569 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:33.749219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 816/1632] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:33 2022] PUT /identity/v3/projects/44848f7b35c748b3865162a425fd78be/users/76b15b3da59442ff964deec4222bb4c5/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:33.750873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76b0c8-f7a0-4667-85b8-a0136a0bf1b2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.751290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76b0c8-f7a0-4667-85b8-a0136a0bf1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.751710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76b0c8-f7a0-4667-85b8-a0136a0bf1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.765975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 817/1633] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:33.769239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc689-c5ef-49e3-aefa-f1bde5972dca None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.772139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc689-c5ef-49e3-aefa-f1bde5972dca None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.784676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc689-c5ef-49e3-aefa-f1bde5972dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.802487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9a76b0c8-f7a0-4667-85b8-a0136a0bf1b2 None None] MFA Rules not processed for user `af63ec4abdc54dc1b852b8e2271bc6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:33.803938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9a76b0c8-f7a0-4667-85b8-a0136a0bf1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:33.843672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d63fc689-c5ef-49e3-aefa-f1bde5972dca None None] MFA Rules not processed for user `76b15b3da59442ff964deec4222bb4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:33.845212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d63fc689-c5ef-49e3-aefa-f1bde5972dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:33.926923 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 817/1634] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:33.928017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76b0c8-f7a0-4667-85b8-a0136a0bf1b2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:33.940233 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:34.006453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 818/1635] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:34.008064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fc689-c5ef-49e3-aefa-f1bde5972dca None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:34.035451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76b0c8-f7a0-4667-85b8-a0136a0bf1b2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:34.044527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58aba-a4c0-4878-abb9-3fe6b7c8741b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:34.045463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58aba-a4c0-4878-abb9-3fe6b7c8741b service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:34.045753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58aba-a4c0-4878-abb9-3fe6b7c8741b service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:34.046031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58aba-a4c0-4878-abb9-3fe6b7c8741b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:34.069375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:34.108031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fc689-c5ef-49e3-aefa-f1bde5972dca None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:34.112818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43974d-95f4-46fe-8a6c-7916d8e9355d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:34.114024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43974d-95f4-46fe-8a6c-7916d8e9355d service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:34.114876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43974d-95f4-46fe-8a6c-7916d8e9355d service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:34.115319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43974d-95f4-46fe-8a6c-7916d8e9355d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:34.133425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43974d-95f4-46fe-8a6c-7916d8e9355d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:34.136103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43974d-95f4-46fe-8a6c-7916d8e9355d service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:34.157326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 819/1636] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:34.172064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e58aba-a4c0-4878-abb9-3fe6b7c8741b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:34.174887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e58aba-a4c0-4878-abb9-3fe6b7c8741b service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:34.191211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 818/1637] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:34.269705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43974d-95f4-46fe-8a6c-7916d8e9355d service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:34.281187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43974d-95f4-46fe-8a6c-7916d8e9355d service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:34.299805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98976c78-56fb-40b1-8581-8acd2e838c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:34.300626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976c78-56fb-40b1-8581-8acd2e838c67 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:34.300988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976c78-56fb-40b1-8581-8acd2e838c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:34.301273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976c78-56fb-40b1-8581-8acd2e838c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:34.328042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98976c78-56fb-40b1-8581-8acd2e838c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:34.331102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98976c78-56fb-40b1-8581-8acd2e838c67 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:34.377788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 820/1638] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:34.750691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58aba-a4c0-4878-abb9-3fe6b7c8741b service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:34.766524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58aba-a4c0-4878-abb9-3fe6b7c8741b service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:34.772253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3c2e1-51f5-4362-9623-0765ea6f0cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:34.773327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c2e1-51f5-4362-9623-0765ea6f0cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:34.773786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c2e1-51f5-4362-9623-0765ea6f0cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:34.774224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c2e1-51f5-4362-9623-0765ea6f0cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:34.860279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3c2e1-51f5-4362-9623-0765ea6f0cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:34.862875 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3c2e1-51f5-4362-9623-0765ea6f0cd5 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:34.878335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 819/1639] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:36.245094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f250ead-652c-46e6-8891-4d0d60033b2f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:36.245711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f250ead-652c-46e6-8891-4d0d60033b2f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:36.245999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f250ead-652c-46e6-8891-4d0d60033b2f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:36.250042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 821/1640] 10.222.0.71 () {54 vars in 962 bytes} [Mon Aug 1 15:37:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:36.278213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe17b-17f4-4c71-8132-d34b6a517fbf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:36.278743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe17b-17f4-4c71-8132-d34b6a517fbf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:36.279040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe17b-17f4-4c71-8132-d34b6a517fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:36.342695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-328fe17b-17f4-4c71-8132-d34b6a517fbf None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:36.346105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-328fe17b-17f4-4c71-8132-d34b6a517fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:36.380305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 820/1641] 10.222.0.71 () {58 vars in 1059 bytes} [Mon Aug 1 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:36.389787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0530a-ff33-4e20-b696-8f4014f9eff6 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:36.390214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0530a-ff33-4e20-b696-8f4014f9eff6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:36.390689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0530a-ff33-4e20-b696-8f4014f9eff6 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:36.396909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 822/1642] 10.222.0.71 () {54 vars in 912 bytes} [Mon Aug 1 15:37:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:36.399086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae981-e23f-462b-a5e5-b33442e2394d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:36.407640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae981-e23f-462b-a5e5-b33442e2394d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:36.408177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae981-e23f-462b-a5e5-b33442e2394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:36.496139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e03ae981-e23f-462b-a5e5-b33442e2394d None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:36.500507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e03ae981-e23f-462b-a5e5-b33442e2394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:36.534194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 821/1643] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:36.567448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0530a-ff33-4e20-b696-8f4014f9eff6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:36.630749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0530a-ff33-4e20-b696-8f4014f9eff6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:36.644909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990853c-ed3c-47e5-bc2d-7cf77fa1c1d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:36.644909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990853c-ed3c-47e5-bc2d-7cf77fa1c1d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:36.644909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990853c-ed3c-47e5-bc2d-7cf77fa1c1d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:36.644909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990853c-ed3c-47e5-bc2d-7cf77fa1c1d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:36.671759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990853c-ed3c-47e5-bc2d-7cf77fa1c1d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:36.674453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990853c-ed3c-47e5-bc2d-7cf77fa1c1d8 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:36.714401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 823/1644] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:39.394662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae981-e23f-462b-a5e5-b33442e2394d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:39.539474 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae981-e23f-462b-a5e5-b33442e2394d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:39.546332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:39.547358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:39.548096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:39.548948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] PATH_INFO: `/v3/users/e538fef072d14a41bf1fc9d635b2feed` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:39.550774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e538fef072d14a41bf1fc9d635b2feed)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:39.552117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:37:39.552117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: warnings.warn(msg) Aug 01 15:37:39.552117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: Aug 01 15:37:39.553827 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:39.615815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990853c-ed3c-47e5-bc2d-7cf77fa1c1d8 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:39.634775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990853c-ed3c-47e5-bc2d-7cf77fa1c1d8 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:39.651426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:39.653261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:39.653927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:39.654426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] PATH_INFO: `/v3/users/277c3debf6ec4c85a223503a5c7ed241` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:39.656211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=277c3debf6ec4c85a223503a5c7ed241)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:39.658301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:39.661685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:39.708639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e538fef072d14a41bf1fc9d635b2feed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.729813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e538fef072d14a41bf1fc9d635b2feed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.756905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e538fef072d14a41bf1fc9d635b2feed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.758705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e538fef072d14a41bf1fc9d635b2feed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.775549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277c3debf6ec4c85a223503a5c7ed241'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.792337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbd0f1bd-2e65-4954-9a1f-db3f4b2bf5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e538fef072d14a41bf1fc9d635b2feed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.795267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277c3debf6ec4c85a223503a5c7ed241'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.797393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277c3debf6ec4c85a223503a5c7ed241'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.827039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 822/1645] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:37:39 2022] DELETE /identity/v3/users/e538fef072d14a41bf1fc9d635b2feed => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:39.828136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277c3debf6ec4c85a223503a5c7ed241'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.829716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-535b5132-d6c8-4d6b-a553-0eb773d6be5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277c3debf6ec4c85a223503a5c7ed241'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:39.830263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de12dd-d188-41ec-b94c-4f4d88c62881 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:39.830613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de12dd-d188-41ec-b94c-4f4d88c62881 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:39.831640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de12dd-d188-41ec-b94c-4f4d88c62881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:39.869394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 824/1646] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:37:39 2022] DELETE /identity/v3/users/277c3debf6ec4c85a223503a5c7ed241 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:37:39.875232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc308d-c285-4501-9044-2be8767e80ff None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:39.878209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc308d-c285-4501-9044-2be8767e80ff None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:39.878878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc308d-c285-4501-9044-2be8767e80ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:39.893313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a3de12dd-d188-41ec-b94c-4f4d88c62881 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:39.900385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a3de12dd-d188-41ec-b94c-4f4d88c62881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:39.914803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-31bc308d-c285-4501-9044-2be8767e80ff None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:39.921710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-31bc308d-c285-4501-9044-2be8767e80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:40.054957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:40.159950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 823/1647] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:40.180803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 825/1648] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:40.187205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de12dd-d188-41ec-b94c-4f4d88c62881 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:40.189944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a3de12dd-d188-41ec-b94c-4f4d88c62881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:40.204343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc308d-c285-4501-9044-2be8767e80ff None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:40.208751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-31bc308d-c285-4501-9044-2be8767e80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:40.345717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc308d-c285-4501-9044-2be8767e80ff None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:40.351930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:40.352577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:40.352863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:40.353141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:40.359275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de12dd-d188-41ec-b94c-4f4d88c62881 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:40.364793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd0285-ba7a-4511-bad2-e01961d4b360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:40.369091 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd0285-ba7a-4511-bad2-e01961d4b360 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:40.369411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd0285-ba7a-4511-bad2-e01961d4b360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:40.369927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd0285-ba7a-4511-bad2-e01961d4b360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:40.377106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:40.379143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:40.383136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd0285-ba7a-4511-bad2-e01961d4b360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:40.390998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd0285-ba7a-4511-bad2-e01961d4b360 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:40.392391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 826/1649] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:40.405084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 824/1650] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:42.275509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:42.277000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:42.295246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db267e2f-1095-4acf-b280-f32a616d5cfa service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:42.307594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:42.308320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:42.316113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:42.316539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] PATH_INFO: `/v3/projects/f0713d3cbec94c3b8487e9cb7cd21a8a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:42.318208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0713d3cbec94c3b8487e9cb7cd21a8a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:42.319631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: WARNING py.warnings [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:37:42.319631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: warnings.warn(msg) Aug 01 15:37:42.319631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: Aug 01 15:37:42.321649 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:42.518619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0713d3cbec94c3b8487e9cb7cd21a8a', 'request_id': 'req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:42.560087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0713d3cbec94c3b8487e9cb7cd21a8a', 'request_id': 'req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:42.610431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0713d3cbec94c3b8487e9cb7cd21a8a', 'request_id': 'req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:42.638145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] The token cache is being invalidate because project f0713d3cbec94c3b8487e9cb7cd21a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:37:42.638749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:42.640484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7cc564d-77f4-4870-9bc7-9ce58e4e628b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:42.648468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 827/1651] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:37:42 2022] DELETE /identity/v3/projects/f0713d3cbec94c3b8487e9cb7cd21a8a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:42.651830 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a34e01-21bf-47c2-b501-3618cc1af07f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:42.654919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a34e01-21bf-47c2-b501-3618cc1af07f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:42.655428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a34e01-21bf-47c2-b501-3618cc1af07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:42.704177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f8a34e01-21bf-47c2-b501-3618cc1af07f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:42.706455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f8a34e01-21bf-47c2-b501-3618cc1af07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:42.862309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:42.932286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 825/1652] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:42.934196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385bac-c3f0-4ecd-b8e1-245773efcf9b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:42.934788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385bac-c3f0-4ecd-b8e1-245773efcf9b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:42.935195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385bac-c3f0-4ecd-b8e1-245773efcf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.002238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-32385bac-c3f0-4ecd-b8e1-245773efcf9b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:43.008867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-32385bac-c3f0-4ecd-b8e1-245773efcf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:43.060843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 828/1653] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:43.067412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a34e01-21bf-47c2-b501-3618cc1af07f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:43.097252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a34e01-21bf-47c2-b501-3618cc1af07f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:43.113342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:43.114005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.114290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.114565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.125275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:43.125985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:43.128525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:43.147494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32385bac-c3f0-4ecd-b8e1-245773efcf9b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:43.148309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-32385bac-c3f0-4ecd-b8e1-245773efcf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:43.188302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32385bac-c3f0-4ecd-b8e1-245773efcf9b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:43.212676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 826/1654] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:43.219913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:43.223848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:43.224527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.224810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.225086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] PATH_INFO: `/v3/projects/a42305fb9594459086839013d9da08d7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.236041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42305fb9594459086839013d9da08d7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:43.241980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:43.268775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62233da-521b-46e1-96b6-cbb6d12de98c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:43.291896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c20cb-4aec-4375-b79f-2e20bc812786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:43.292548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c20cb-4aec-4375-b79f-2e20bc812786 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.293464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c20cb-4aec-4375-b79f-2e20bc812786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.293750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c20cb-4aec-4375-b79f-2e20bc812786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.294453 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c20cb-4aec-4375-b79f-2e20bc812786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:43.296594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c20cb-4aec-4375-b79f-2e20bc812786 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:43.374046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:43.399623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42305fb9594459086839013d9da08d7', 'request_id': 'req-0f62da2e-f489-40dc-8935-4667a6a8cdd9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.429176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42305fb9594459086839013d9da08d7', 'request_id': 'req-0f62da2e-f489-40dc-8935-4667a6a8cdd9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.444614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 827/1655] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:43 2022] POST /identity/v3/projects => generated 367 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:43.447031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42305fb9594459086839013d9da08d7', 'request_id': 'req-0f62da2e-f489-40dc-8935-4667a6a8cdd9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.448895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c20cb-4aec-4375-b79f-2e20bc812786 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:43.482339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] The token cache is being invalidate because project a42305fb9594459086839013d9da08d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:37:43.484070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.487455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.498861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 829/1656] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:37:43 2022] DELETE /identity/v3/projects/a42305fb9594459086839013d9da08d7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:37:43.502792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:43.510457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:43.672732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c20cb-4aec-4375-b79f-2e20bc812786 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:43.686101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62da2e-f489-40dc-8935-4667a6a8cdd9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:43.694482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:43.695161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.695467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.695746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] PATH_INFO: `/v3/users/76b15b3da59442ff964deec4222bb4c5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.700385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b15b3da59442ff964deec4222bb4c5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:43.700797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:43.702392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:43.702641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.703179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.703677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.704754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:43.707291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:43.766386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 828/1657] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:43 2022] POST /identity/v3/users => generated 284 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:37:43.770638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:43.781352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:43.804389 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148512d4-bfe5-488b-8f0f-9e542425405a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:43.828275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d188b3-1f6f-4b59-9992-f6ec7781db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:43.830165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d188b3-1f6f-4b59-9992-f6ec7781db1c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.830830 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d188b3-1f6f-4b59-9992-f6ec7781db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.831271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d188b3-1f6f-4b59-9992-f6ec7781db1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.832350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d188b3-1f6f-4b59-9992-f6ec7781db1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:43.834548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d188b3-1f6f-4b59-9992-f6ec7781db1c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:43.847103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b15b3da59442ff964deec4222bb4c5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.862855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 829/1658] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:43.867247 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d188b3-1f6f-4b59-9992-f6ec7781db1c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:43.869695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b15b3da59442ff964deec4222bb4c5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.870543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b15b3da59442ff964deec4222bb4c5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.893572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b15b3da59442ff964deec4222bb4c5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.894684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b15b3da59442ff964deec4222bb4c5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:43.898681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d188b3-1f6f-4b59-9992-f6ec7781db1c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:43.920002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 830/1659] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:37:43 2022] DELETE /identity/v3/users/76b15b3da59442ff964deec4222bb4c5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:43.927236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562fdeb-e868-4a52-8988-d96cd36489ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:43.927921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fdeb-e868-4a52-8988-d96cd36489ac admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.928202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fdeb-e868-4a52-8988-d96cd36489ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.928477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fdeb-e868-4a52-8988-d96cd36489ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.929198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562fdeb-e868-4a52-8988-d96cd36489ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:43.930855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562fdeb-e868-4a52-8988-d96cd36489ac admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:44.035963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 830/1660] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:44.039553 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:44.041816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:44.151723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:44.200276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efcab1-f7e7-4e0c-b5d4-46014b6ef280 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:44.217874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:44.218604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:44.218894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:44.219175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] PATH_INFO: `/v3/projects/a1a5637e6ac04209bb890765d59d7db6/users/2f02df1044884fb0939aaf8a04ff5da4/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:44.268969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a5637e6ac04209bb890765d59d7db6, user_id=2f02df1044884fb0939aaf8a04ff5da4, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:44.276571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:44.327489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 831/1661] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:44 2022] PUT /identity/v3/projects/a1a5637e6ac04209bb890765d59d7db6/users/2f02df1044884fb0939aaf8a04ff5da4/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:44.330657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5b81-f819-4c0e-b3d5-b887496e122c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:44.331263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5b81-f819-4c0e-b3d5-b887496e122c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:44.331717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5b81-f819-4c0e-b3d5-b887496e122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:44.434603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e87a5b81-f819-4c0e-b3d5-b887496e122c None None] MFA Rules not processed for user `2f02df1044884fb0939aaf8a04ff5da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:44.436226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e87a5b81-f819-4c0e-b3d5-b887496e122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:44.648416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 831/1662] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:44.660631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:44.663350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:44.908699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe252b-4b2e-47e8-b31b-ac04c08f5c45 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:44.920361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852b9c6-3014-44ea-8d53-9ee7c2c9552b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:44.921036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852b9c6-3014-44ea-8d53-9ee7c2c9552b service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:44.921385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852b9c6-3014-44ea-8d53-9ee7c2c9552b service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:44.923775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852b9c6-3014-44ea-8d53-9ee7c2c9552b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:44.950613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852b9c6-3014-44ea-8d53-9ee7c2c9552b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:44.952166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852b9c6-3014-44ea-8d53-9ee7c2c9552b service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:44.981487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 832/1663] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:45.572703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552639f-3010-4d23-8b1e-99f3a4212ba9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:45.574353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552639f-3010-4d23-8b1e-99f3a4212ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:45.574926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552639f-3010-4d23-8b1e-99f3a4212ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:45.685397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:45.712556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e552639f-3010-4d23-8b1e-99f3a4212ba9 None None] MFA Rules not processed for user `e4a4c21d432448fcbb75e000741d5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:45.714001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e552639f-3010-4d23-8b1e-99f3a4212ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:45.922655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 832/1664] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:45.943083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942750-19a4-4081-aa9b-e204a6c44e8f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:45.943644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942750-19a4-4081-aa9b-e204a6c44e8f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:45.943644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942750-19a4-4081-aa9b-e204a6c44e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:45.985956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-68942750-19a4-4081-aa9b-e204a6c44e8f None None] MFA Rules not processed for user `e4a4c21d432448fcbb75e000741d5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:45.987730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-68942750-19a4-4081-aa9b-e204a6c44e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:46.013106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 833/1665] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:46.027001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552639f-3010-4d23-8b1e-99f3a4212ba9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:46.028547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e552639f-3010-4d23-8b1e-99f3a4212ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:46.184575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552639f-3010-4d23-8b1e-99f3a4212ba9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:46.193178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d32738-fbef-46c4-9b2b-610ac3f4e5a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:46.193946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32738-fbef-46c4-9b2b-610ac3f4e5a6 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.196471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32738-fbef-46c4-9b2b-610ac3f4e5a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.196885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32738-fbef-46c4-9b2b-610ac3f4e5a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.211130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32738-fbef-46c4-9b2b-610ac3f4e5a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:46.212840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32738-fbef-46c4-9b2b-610ac3f4e5a6 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:46.225284 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 833/1666] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:46.624969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68942750-19a4-4081-aa9b-e204a6c44e8f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:46.626847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-68942750-19a4-4081-aa9b-e204a6c44e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:46.690985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e24b-c80e-4ac7-9062-db4807109763 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.691722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e24b-c80e-4ac7-9062-db4807109763 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.691722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e24b-c80e-4ac7-9062-db4807109763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.787164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7e12e24b-c80e-4ac7-9062-db4807109763 None None] MFA Rules not processed for user `eb98fec3c7394d889b77544ac52643b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:46.789760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7e12e24b-c80e-4ac7-9062-db4807109763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:46.934622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68942750-19a4-4081-aa9b-e204a6c44e8f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:46.952865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:46.954091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.954677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.955258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] PATH_INFO: `/v3/projects/44848f7b35c748b3865162a425fd78be` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.957605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=44848f7b35c748b3865162a425fd78be)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:46.963487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:47.043064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 834/1667] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:47.058160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f03a92-a02a-4c03-9e57-b0769837b015 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:47.059646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f03a92-a02a-4c03-9e57-b0769837b015 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:47.060254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f03a92-a02a-4c03-9e57-b0769837b015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.082528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44848f7b35c748b3865162a425fd78be', 'request_id': 'req-7675dcd1-5413-486d-8a20-70fc923c5a6b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:47.095893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44848f7b35c748b3865162a425fd78be', 'request_id': 'req-7675dcd1-5413-486d-8a20-70fc923c5a6b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:47.103350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e4f03a92-a02a-4c03-9e57-b0769837b015 None None] MFA Rules not processed for user `eb98fec3c7394d889b77544ac52643b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:47.104931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e4f03a92-a02a-4c03-9e57-b0769837b015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:47.118520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44848f7b35c748b3865162a425fd78be', 'request_id': 'req-7675dcd1-5413-486d-8a20-70fc923c5a6b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:47.147105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:47.148212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:47.151909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] The token cache is being invalidate because project 44848f7b35c748b3865162a425fd78be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:37:47.152104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:47.153240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7675dcd1-5413-486d-8a20-70fc923c5a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:47.158715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 834/1668] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:37:46 2022] DELETE /identity/v3/projects/44848f7b35c748b3865162a425fd78be => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:47.165878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559ab0-a100-459f-82cd-d3145c733d53 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:47.166053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559ab0-a100-459f-82cd-d3145c733d53 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:47.166352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559ab0-a100-459f-82cd-d3145c733d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.235519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7e559ab0-a100-459f-82cd-d3145c733d53 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:47.239207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7e559ab0-a100-459f-82cd-d3145c733d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:47.321548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 835/1669] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:47.340834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f03a92-a02a-4c03-9e57-b0769837b015 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:47.344789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e4f03a92-a02a-4c03-9e57-b0769837b015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:47.516867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 835/1670] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:47.524890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6a25-9c4f-4add-97e0-af11323413e2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:47.525172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6a25-9c4f-4add-97e0-af11323413e2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:47.530409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6a25-9c4f-4add-97e0-af11323413e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.611577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f03a92-a02a-4c03-9e57-b0769837b015 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:47.623404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d05a6a25-9c4f-4add-97e0-af11323413e2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:47.625150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d05a6a25-9c4f-4add-97e0-af11323413e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:47.641317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:47.642394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:47.642887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:47.643606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.652822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:47.662813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 836/1671] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:47.665492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a6a25-9c4f-4add-97e0-af11323413e2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:47.700489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a6a25-9c4f-4add-97e0-af11323413e2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:47.707240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:47.712354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:47.719759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:47.724310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:47.725313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:47.727091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.729209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:47.733154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:47.740017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 836/1672] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:37:47.758054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:47.810206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 837/1673] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:47.831872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:47.857775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e944-b458-48e4-83c5-78cabf28d2f0 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:47.880623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d42d0-7d46-4f23-a173-29171dc6ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:47.883252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d42d0-7d46-4f23-a173-29171dc6ad8c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:47.884209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d42d0-7d46-4f23-a173-29171dc6ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:47.887421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d42d0-7d46-4f23-a173-29171dc6ad8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.888816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d42d0-7d46-4f23-a173-29171dc6ad8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:47.903156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d42d0-7d46-4f23-a173-29171dc6ad8c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:48.015038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 837/1674] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:47 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:48.018122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:48.033195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ce7d-ed6e-48ed-8d59-d3227f44c272 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:48.104687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aec57-3317-49a4-91c1-1d91d43e00db None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:48.104980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aec57-3317-49a4-91c1-1d91d43e00db None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:48.105802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aec57-3317-49a4-91c1-1d91d43e00db None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:48.107205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 838/1675] 10.222.0.71 () {54 vars in 912 bytes} [Mon Aug 1 15:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:48.123737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094adf9-f22d-4d0d-9c61-fe2cc7c7cc7a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:48.124034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094adf9-f22d-4d0d-9c61-fe2cc7c7cc7a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:48.124413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094adf9-f22d-4d0d-9c61-fe2cc7c7cc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:48.266247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a978eb-24be-4fb7-8785-c24d4b4fef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:48.266965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a978eb-24be-4fb7-8785-c24d4b4fef80 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:48.268579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a978eb-24be-4fb7-8785-c24d4b4fef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:48.268889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a978eb-24be-4fb7-8785-c24d4b4fef80 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:48.271063 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a978eb-24be-4fb7-8785-c24d4b4fef80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:48.287428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a978eb-24be-4fb7-8785-c24d4b4fef80 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:48.287746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5094adf9-f22d-4d0d-9c61-fe2cc7c7cc7a None None] MFA Rules not processed for user `1a1f3e1faeba451488854da4236359ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:48.287746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5094adf9-f22d-4d0d-9c61-fe2cc7c7cc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:48.323329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 838/1676] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:48 2022] POST /identity/v3/users => generated 290 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:48.327057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a978eb-24be-4fb7-8785-c24d4b4fef80 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:48.358697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a978eb-24be-4fb7-8785-c24d4b4fef80 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:48.381157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:48.381785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:48.382065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:48.385432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:48.386232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:48.389646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:48.415175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 839/1677] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:48.434337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 839/1678] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:48.438151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094adf9-f22d-4d0d-9c61-fe2cc7c7cc7a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:48.462490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094adf9-f22d-4d0d-9c61-fe2cc7c7cc7a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:48.481990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de55a5c-ef89-4c98-ad73-41dd7db3361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:48.483189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de55a5c-ef89-4c98-ad73-41dd7db3361f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:48.484785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:48.485996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de55a5c-ef89-4c98-ad73-41dd7db3361f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:48.486812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de55a5c-ef89-4c98-ad73-41dd7db3361f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:48.486951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:48.487976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de55a5c-ef89-4c98-ad73-41dd7db3361f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:48.491540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de55a5c-ef89-4c98-ad73-41dd7db3361f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:48.511028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fce87-bdd1-4907-98fc-5086b5e1c83c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:48.524521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 840/1679] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:48.528586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de55a5c-ef89-4c98-ad73-41dd7db3361f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:48.532360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39affd-dfb9-446e-9845-8139542dfa17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:48.533014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39affd-dfb9-446e-9845-8139542dfa17 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:48.533298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39affd-dfb9-446e-9845-8139542dfa17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:48.533571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39affd-dfb9-446e-9845-8139542dfa17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:48.559884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de55a5c-ef89-4c98-ad73-41dd7db3361f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:48.564275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39affd-dfb9-446e-9845-8139542dfa17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:48.565750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39affd-dfb9-446e-9845-8139542dfa17 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:48.570921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba169913-e6fc-4f04-a73c-1ede789b4c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:48.571695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169913-e6fc-4f04-a73c-1ede789b4c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:48.571985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169913-e6fc-4f04-a73c-1ede789b4c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:48.578643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169913-e6fc-4f04-a73c-1ede789b4c6a admin admin] PATH_INFO: `/v3/projects/34183feb6543451d8ecec48fb3728b0e/users/8a8465be84214beea22c46280c3962cb/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:48.581660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:48.609624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 840/1680] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:37:48.628364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba169913-e6fc-4f04-a73c-1ede789b4c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34183feb6543451d8ecec48fb3728b0e, user_id=8a8465be84214beea22c46280c3962cb, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:48.634351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba169913-e6fc-4f04-a73c-1ede789b4c6a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:48.685948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 841/1681] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:48 2022] PUT /identity/v3/projects/34183feb6543451d8ecec48fb3728b0e/users/8a8465be84214beea22c46280c3962cb/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:37:48.689993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c877f2-87f8-47a5-a43d-df22a8303c2a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:48.690286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c877f2-87f8-47a5-a43d-df22a8303c2a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:48.691257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c877f2-87f8-47a5-a43d-df22a8303c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:48.817254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-29c877f2-87f8-47a5-a43d-df22a8303c2a None None] MFA Rules not processed for user `8a8465be84214beea22c46280c3962cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:48.819868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-29c877f2-87f8-47a5-a43d-df22a8303c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:48.944041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:49.121903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 841/1682] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:49.123554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba169913-e6fc-4f04-a73c-1ede789b4c6a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:49.333741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba169913-e6fc-4f04-a73c-1ede789b4c6a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:49.340697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927fd91-002e-4ab0-9df9-ebe7cd15e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:49.341359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927fd91-002e-4ab0-9df9-ebe7cd15e00c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.343194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927fd91-002e-4ab0-9df9-ebe7cd15e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.343528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927fd91-002e-4ab0-9df9-ebe7cd15e00c admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.344483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927fd91-002e-4ab0-9df9-ebe7cd15e00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:49.346655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927fd91-002e-4ab0-9df9-ebe7cd15e00c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:49.414684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 842/1683] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:49 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:37:49.416047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c877f2-87f8-47a5-a43d-df22a8303c2a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:49.442531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c877f2-87f8-47a5-a43d-df22a8303c2a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:49.479278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58ee6-e95e-4733-b662-9cc1ccfa188c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.479690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58ee6-e95e-4733-b662-9cc1ccfa188c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.480056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58ee6-e95e-4733-b662-9cc1ccfa188c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.481651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 843/1684] 10.222.0.71 () {54 vars in 912 bytes} [Mon Aug 1 15:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:49.488320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a021e4-87f4-44de-9e07-e7bf2ca32067 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.488636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a021e4-87f4-44de-9e07-e7bf2ca32067 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.489095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a021e4-87f4-44de-9e07-e7bf2ca32067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.546466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-80a021e4-87f4-44de-9e07-e7bf2ca32067 None None] MFA Rules not processed for user `1a1f3e1faeba451488854da4236359ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:49.549296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-80a021e4-87f4-44de-9e07-e7bf2ca32067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:49.632943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a41b22-ec5b-4928-a20c-c7b9b93ffaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:49.633573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41b22-ec5b-4928-a20c-c7b9b93ffaff admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.633859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41b22-ec5b-4928-a20c-c7b9b93ffaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.634132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41b22-ec5b-4928-a20c-c7b9b93ffaff admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.634813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a41b22-ec5b-4928-a20c-c7b9b93ffaff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:49.637464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a41b22-ec5b-4928-a20c-c7b9b93ffaff admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:49.687869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 842/1685] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:49 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:49.689327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd5af-2d37-4e10-9ab3-d6b313c79156 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.689620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd5af-2d37-4e10-9ab3-d6b313c79156 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.689906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd5af-2d37-4e10-9ab3-d6b313c79156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.725923 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 844/1686] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:49.727335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a021e4-87f4-44de-9e07-e7bf2ca32067 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:49.764434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a021e4-87f4-44de-9e07-e7bf2ca32067 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:49.778673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231155bc-51a7-4c6f-9b44-1b1690fbebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:49.779280 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231155bc-51a7-4c6f-9b44-1b1690fbebd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.779965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231155bc-51a7-4c6f-9b44-1b1690fbebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.781611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231155bc-51a7-4c6f-9b44-1b1690fbebd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.784211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231155bc-51a7-4c6f-9b44-1b1690fbebd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:49.790505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231155bc-51a7-4c6f-9b44-1b1690fbebd0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:49.810308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-761dd5af-2d37-4e10-9ab3-d6b313c79156 None None] MFA Rules not processed for user `b325a118b0964730ada2630cd2b47fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:49.812901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-761dd5af-2d37-4e10-9ab3-d6b313c79156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:49.815831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 845/1687] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:49.820920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231155bc-51a7-4c6f-9b44-1b1690fbebd0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:49.836343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231155bc-51a7-4c6f-9b44-1b1690fbebd0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:49.846725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19f78f-cbea-48d9-801d-c02f48751079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:49.849270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f78f-cbea-48d9-801d-c02f48751079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.849562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f78f-cbea-48d9-801d-c02f48751079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.849851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f78f-cbea-48d9-801d-c02f48751079 admin admin] PATH_INFO: `/v3/projects/7b28f6811f2e4ad6ae6f63d8d63c23a9/users/1b9e2ee66dc64f56b9e0ab15fb7f31e3/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.937882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19f78f-cbea-48d9-801d-c02f48751079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b28f6811f2e4ad6ae6f63d8d63c23a9, user_id=1b9e2ee66dc64f56b9e0ab15fb7f31e3, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:49.947992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19f78f-cbea-48d9-801d-c02f48751079 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:50.005199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 846/1688] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:49 2022] PUT /identity/v3/projects/7b28f6811f2e4ad6ae6f63d8d63c23a9/users/1b9e2ee66dc64f56b9e0ab15fb7f31e3/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:50.006834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19f78f-cbea-48d9-801d-c02f48751079 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:50.068171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 843/1689] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:50.080419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dd5af-2d37-4e10-9ab3-d6b313c79156 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:50.111311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dd5af-2d37-4e10-9ab3-d6b313c79156 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:50.144881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:50.186634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19f78f-cbea-48d9-801d-c02f48751079 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:50.197206 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af112f-a3b8-4f55-940e-4c4719c53582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:50.201385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af112f-a3b8-4f55-940e-4c4719c53582 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.201731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af112f-a3b8-4f55-940e-4c4719c53582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.202724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af112f-a3b8-4f55-940e-4c4719c53582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:50.235644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af112f-a3b8-4f55-940e-4c4719c53582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:50.246656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af112f-a3b8-4f55-940e-4c4719c53582 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:50.288331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:50.310205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:50.311071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.311619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.311901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:50.321204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 847/1690] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:50.340608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:50.349576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:50.381163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 844/1691] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:50.385782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af112f-a3b8-4f55-940e-4c4719c53582 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:50.403777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af112f-a3b8-4f55-940e-4c4719c53582 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:50.418593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a02c0-cc3c-4ff9-9e2c-3a9c6e8da573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:50.419304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a02c0-cc3c-4ff9-9e2c-3a9c6e8da573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.419646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a02c0-cc3c-4ff9-9e2c-3a9c6e8da573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.419929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a02c0-cc3c-4ff9-9e2c-3a9c6e8da573 admin admin] PATH_INFO: `/v3/projects/7b28f6811f2e4ad6ae6f63d8d63c23a9/users/1b9e2ee66dc64f56b9e0ab15fb7f31e3/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:50.426970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a02c0-cc3c-4ff9-9e2c-3a9c6e8da573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b28f6811f2e4ad6ae6f63d8d63c23a9, user_id=1b9e2ee66dc64f56b9e0ab15fb7f31e3, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:50.447226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a02c0-cc3c-4ff9-9e2c-3a9c6e8da573 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:50.517612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:50.526899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:50.536313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 848/1692] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:37:50 2022] PUT /identity/v3/projects/7b28f6811f2e4ad6ae6f63d8d63c23a9/users/1b9e2ee66dc64f56b9e0ab15fb7f31e3/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:50.548050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731028c1-3282-4b57-99f2-bda1ca858643 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.548348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731028c1-3282-4b57-99f2-bda1ca858643 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.556874 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731028c1-3282-4b57-99f2-bda1ca858643 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:50.565679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 849/1693] 10.222.0.71 () {54 vars in 961 bytes} [Mon Aug 1 15:37:50 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:50.569354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5c5a-6b68-4358-899c-81799f728a4e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.569578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5c5a-6b68-4358-899c-81799f728a4e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.570034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5c5a-6b68-4358-899c-81799f728a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:50.669287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3d7f5c5a-6b68-4358-899c-81799f728a4e None None] MFA Rules not processed for user `1b9e2ee66dc64f56b9e0ab15fb7f31e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:50.671355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3d7f5c5a-6b68-4358-899c-81799f728a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:50.820580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee8ed9-b59f-422d-b1a1-7137291d1f19 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:50.927045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 850/1694] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:50.928935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acaf79-ec57-4cb0-ab9b-80986de373fe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.929243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acaf79-ec57-4cb0-ab9b-80986de373fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.929530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acaf79-ec57-4cb0-ab9b-80986de373fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:51.021390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d7acaf79-ec57-4cb0-ab9b-80986de373fe None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:51.023164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d7acaf79-ec57-4cb0-ab9b-80986de373fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:51.042762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:51.043768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:51.044314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:51.044736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:51.206420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:51.213393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:51.244496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 845/1695] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:51.249458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:51.269257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:51.287148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 851/1696] 10.222.0.71 () {58 vars in 1058 bytes} [Mon Aug 1 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:51.299700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acaf79-ec57-4cb0-ab9b-80986de373fe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:51.318730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acaf79-ec57-4cb0-ab9b-80986de373fe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:51.334784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb33960-1111-4ef1-995f-8eeee3017799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:51.335472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33960-1111-4ef1-995f-8eeee3017799 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:51.335762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33960-1111-4ef1-995f-8eeee3017799 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:51.336042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33960-1111-4ef1-995f-8eeee3017799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:51.347644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-afb33960-1111-4ef1-995f-8eeee3017799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:51.393449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:51.465974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33960-1111-4ef1-995f-8eeee3017799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:51.475884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33960-1111-4ef1-995f-8eeee3017799 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:51.533184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aeb8d-c0ef-418e-99e3-e66bb2bc0d53 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:51.551254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 852/1697] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:51.552169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0944-b681-42ce-a942-3d01baebba40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:51.553201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0944-b681-42ce-a942-3d01baebba40 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:51.553201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0944-b681-42ce-a942-3d01baebba40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:51.553623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0944-b681-42ce-a942-3d01baebba40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:51.582567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0944-b681-42ce-a942-3d01baebba40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:51.588602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0944-b681-42ce-a942-3d01baebba40 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:51.613065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 846/1698] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:51.832896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043b18-db83-4498-b61a-e9609c1dcf68 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:51.833737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043b18-db83-4498-b61a-e9609c1dcf68 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:51.834542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043b18-db83-4498-b61a-e9609c1dcf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:51.945505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bb043b18-db83-4498-b61a-e9609c1dcf68 None None] MFA Rules not processed for user `e4a4c21d432448fcbb75e000741d5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:51.955332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bb043b18-db83-4498-b61a-e9609c1dcf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:52.126146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:52.269968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 853/1699] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:52.780286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0944-b681-42ce-a942-3d01baebba40 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:52.811668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0944-b681-42ce-a942-3d01baebba40 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:52.830721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9e2ee66dc64f56b9e0ab15fb7f31e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b28f6811f2e4ad6ae6f63d8d63c23a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:52.832201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.833939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.836535 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.839319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:52.842013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:52.849892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:52.927214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043b18-db83-4498-b61a-e9609c1dcf68 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:52.930215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 847/1700] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:52.950098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043b18-db83-4498-b61a-e9609c1dcf68 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:52.969120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792208c-b43c-45dc-ad8b-8c1027d1a26c tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9e2ee66dc64f56b9e0ab15fb7f31e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b28f6811f2e4ad6ae6f63d8d63c23a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:52.969901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792208c-b43c-45dc-ad8b-8c1027d1a26c tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.970192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792208c-b43c-45dc-ad8b-8c1027d1a26c tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.970467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792208c-b43c-45dc-ad8b-8c1027d1a26c tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.976442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792208c-b43c-45dc-ad8b-8c1027d1a26c tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:52.987361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792208c-b43c-45dc-ad8b-8c1027d1a26c tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:53.065509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 854/1701] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:37:52 2022] POST /identity/v3/projects => generated 355 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:53.072082 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:53.128391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fb235-742b-465c-935e-b54719fe8eed tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:53.430567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9e2ee66dc64f56b9e0ab15fb7f31e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b28f6811f2e4ad6ae6f63d8d63c23a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:53.432185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:53.432712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:53.433270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:53.434639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:53.437677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:53.454132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:53.516302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 848/1702] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:53.572626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792208c-b43c-45dc-ad8b-8c1027d1a26c tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:53.596390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792208c-b43c-45dc-ad8b-8c1027d1a26c tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:53.613566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9e2ee66dc64f56b9e0ab15fb7f31e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b28f6811f2e4ad6ae6f63d8d63c23a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:53.614624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:53.615114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:53.615620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] PATH_INFO: `/v3/projects/a780ac4af316443c9d8ca9e1e0431943` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:53.620086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a780ac4af316443c9d8ca9e1e0431943)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:53.624131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:53.749999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a780ac4af316443c9d8ca9e1e0431943', 'request_id': 'req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:53.766778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a780ac4af316443c9d8ca9e1e0431943', 'request_id': 'req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:53.783118 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a780ac4af316443c9d8ca9e1e0431943', 'request_id': 'req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:53.813126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] The token cache is being invalidate because project a780ac4af316443c9d8ca9e1e0431943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:37:53.813577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:53.814895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d7e4555b-b1a7-402b-b0e8-bdf8d4d672c7 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:53.818662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 855/1703] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:37:53 2022] DELETE /identity/v3/projects/a780ac4af316443c9d8ca9e1e0431943 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:54.665537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:54.669193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:54.836362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca224ec-4867-4196-be87-c6dc5c6a5f96 tempest-VolumeQuotaClassesTest-669957718 tempest-VolumeQuotaClassesTest-669957718-project-admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:55.043887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:55.091130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:55.092048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:55.092487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:55.092916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] PATH_INFO: `/v3/users/8a8465be84214beea22c46280c3962cb` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:55.095546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8465be84214beea22c46280c3962cb)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:55.098697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:55.278428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8465be84214beea22c46280c3962cb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:55.304122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8465be84214beea22c46280c3962cb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:55.310263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8465be84214beea22c46280c3962cb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:55.361521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8465be84214beea22c46280c3962cb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:55.367155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8465be84214beea22c46280c3962cb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:55.465987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 849/1704] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:37:54 2022] DELETE /identity/v3/users/8a8465be84214beea22c46280c3962cb => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:55.491949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b5e1-9b3c-4e09-8685-bebef796cd6f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:55.494409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b5e1-9b3c-4e09-8685-bebef796cd6f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:55.495908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b5e1-9b3c-4e09-8685-bebef796cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:55.571278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c391b5e1-9b3c-4e09-8685-bebef796cd6f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:55.573160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c391b5e1-9b3c-4e09-8685-bebef796cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:55.850548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 856/1705] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:55.920724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:55.926006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:56.288041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1192176-05bb-4847-86bc-71517c36475d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:56.296155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:56.297060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:56.298911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:56.299774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:56.313973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:56.316782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:56.330341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 850/1706] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:56.757498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaae0d0-5228-417e-81b7-b716a10aa8e8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:56.758056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaae0d0-5228-417e-81b7-b716a10aa8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:56.758336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaae0d0-5228-417e-81b7-b716a10aa8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:56.916809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-caaae0d0-5228-417e-81b7-b716a10aa8e8 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:56.919443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-caaae0d0-5228-417e-81b7-b716a10aa8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:56.998942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:57.090151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 857/1707] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:57.464206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:57.466508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:57.704981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:57.710229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76aa81-5763-4551-b5b9-4b55e0a1250c service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:57.730053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:57.730780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:57.730980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:57.731453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:57.752946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:57.754515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:57.779522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 851/1708] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:37:57.847422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd578f4-8b6e-43f9-b716-8fec5b9b1431 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:57.848294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd578f4-8b6e-43f9-b716-8fec5b9b1431 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:57.848719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd578f4-8b6e-43f9-b716-8fec5b9b1431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:57.911013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8fd578f4-8b6e-43f9-b716-8fec5b9b1431 None None] MFA Rules not processed for user `f4fa2b7534d0498f9e30c382e640c878`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:57.912850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8fd578f4-8b6e-43f9-b716-8fec5b9b1431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:58.004921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:58.017693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:58.083346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659a5a1-ce16-448e-ae35-24203f5dfbd4 service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:58.107715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:58.110381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:58.112405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:58.113590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] PATH_INFO: `/v3/users/6308f2c629ec43cbbbe342bbc02cf74b` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:58.124411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6308f2c629ec43cbbbe342bbc02cf74b)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:58.134463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:58.361973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6308f2c629ec43cbbbe342bbc02cf74b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:58.398131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6308f2c629ec43cbbbe342bbc02cf74b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:58.400242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6308f2c629ec43cbbbe342bbc02cf74b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:58.441726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 858/1709] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 588 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:58.468435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88112a5-1803-432a-8624-b6d00b570fb3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:58.468722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88112a5-1803-432a-8624-b6d00b570fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:58.469177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88112a5-1803-432a-8624-b6d00b570fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:58.471403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6308f2c629ec43cbbbe342bbc02cf74b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:58.474091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-932e24bf-dfe4-4443-b583-2fad7e6201c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6308f2c629ec43cbbbe342bbc02cf74b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:37:58.529501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 852/1710] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:37:58 2022] DELETE /identity/v3/users/6308f2c629ec43cbbbe342bbc02cf74b => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:58.538136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1290-21cb-47c8-8cb7-8b46e42d4dd6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:58.538687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1290-21cb-47c8-8cb7-8b46e42d4dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:58.539643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1290-21cb-47c8-8cb7-8b46e42d4dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:58.571310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-aaeb1290-21cb-47c8-8cb7-8b46e42d4dd6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:58.573491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-aaeb1290-21cb-47c8-8cb7-8b46e42d4dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:58.604668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d88112a5-1803-432a-8624-b6d00b570fb3 None None] MFA Rules not processed for user `b325a118b0964730ada2630cd2b47fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:58.606811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d88112a5-1803-432a-8624-b6d00b570fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:58.882588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 853/1711] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:58.882588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1290-21cb-47c8-8cb7-8b46e42d4dd6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:58.906731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-aaeb1290-21cb-47c8-8cb7-8b46e42d4dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:58.951283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 859/1712] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:58.952456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88112a5-1803-432a-8624-b6d00b570fb3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:58.960271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d88112a5-1803-432a-8624-b6d00b570fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:59.206151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88112a5-1803-432a-8624-b6d00b570fb3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:59.219145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:59.219967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:59.220365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:59.220751 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:59.243415 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:59.257564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:59.259148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:59.326170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 860/1713] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:59.419519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:59.502891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1290-21cb-47c8-8cb7-8b46e42d4dd6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:59.559954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:59.559954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:59.559954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:59.562179 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:59.569945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:59.955183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:59.958394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:59.992628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 854/1714] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:37:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 1112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:00.996279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:01.000237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:01.025128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601b64-4e7c-486d-9675-608bc9e7a1e2 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:01.041176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:01.042029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:01.042407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:01.043586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] PATH_INFO: `/v3/projects/34183feb6543451d8ecec48fb3728b0e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:01.046876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34183feb6543451d8ecec48fb3728b0e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:01.049634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:01.064200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:01.066412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:01.097892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949093-b433-4d24-a07f-25b30cbcd66c service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:01.110897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:01.112897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:01.113188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:01.113598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] PATH_INFO: `/v3/users/2f02df1044884fb0939aaf8a04ff5da4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:01.117622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f02df1044884fb0939aaf8a04ff5da4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:01.124710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:01.157482 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34183feb6543451d8ecec48fb3728b0e', 'request_id': 'req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.183064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34183feb6543451d8ecec48fb3728b0e', 'request_id': 'req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.201179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34183feb6543451d8ecec48fb3728b0e', 'request_id': 'req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.228772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] The token cache is being invalidate because project 34183feb6543451d8ecec48fb3728b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:01.229390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.231877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.250137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 861/1715] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:00 2022] DELETE /identity/v3/projects/34183feb6543451d8ecec48fb3728b0e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:01.251722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:01.259555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:01.269577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f02df1044884fb0939aaf8a04ff5da4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.281534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f02df1044884fb0939aaf8a04ff5da4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.282314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f02df1044884fb0939aaf8a04ff5da4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.310866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f02df1044884fb0939aaf8a04ff5da4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.312209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c29d676d-bc60-4359-a342-f956778caf8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f02df1044884fb0939aaf8a04ff5da4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:01.334234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 855/1716] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:01 2022] DELETE /identity/v3/users/2f02df1044884fb0939aaf8a04ff5da4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:01.335874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111ce6-f763-4694-9b03-0c3d3741a2b6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:01.336166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111ce6-f763-4694-9b03-0c3d3741a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:01.336450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111ce6-f763-4694-9b03-0c3d3741a2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:01.390594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-74111ce6-f763-4694-9b03-0c3d3741a2b6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:01.393276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-74111ce6-f763-4694-9b03-0c3d3741a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:01.488582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efcdb3-0a6f-4c8b-b5d0-7259e846f7f9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:01.532741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 856/1717] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:01.689587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:01.690499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:01.690672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:01.690809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] PATH_INFO: `/v3/users/1b9e2ee66dc64f56b9e0ab15fb7f31e3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:01.692756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9e2ee66dc64f56b9e0ab15fb7f31e3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:01.697683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:01.738876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74111ce6-f763-4694-9b03-0c3d3741a2b6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:01.742636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-74111ce6-f763-4694-9b03-0c3d3741a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:01.770507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:01.862337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:01.904481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74111ce6-f763-4694-9b03-0c3d3741a2b6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:01.910415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca412d93-0c4a-4a35-9eb1-28008b08b469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:01.911632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412d93-0c4a-4a35-9eb1-28008b08b469 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:01.912459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412d93-0c4a-4a35-9eb1-28008b08b469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:01.913341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412d93-0c4a-4a35-9eb1-28008b08b469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:01.939439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca412d93-0c4a-4a35-9eb1-28008b08b469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:01.954268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca412d93-0c4a-4a35-9eb1-28008b08b469 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:01.976487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 857/1718] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:01.979695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9e2ee66dc64f56b9e0ab15fb7f31e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:02.022607 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9e2ee66dc64f56b9e0ab15fb7f31e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:02.060797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9e2ee66dc64f56b9e0ab15fb7f31e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:02.064869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9e2ee66dc64f56b9e0ab15fb7f31e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:02.102418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a95c2b36-a2e2-4476-949d-b1a3af06183e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9e2ee66dc64f56b9e0ab15fb7f31e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:02.121178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 862/1719] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:01 2022] DELETE /identity/v3/users/1b9e2ee66dc64f56b9e0ab15fb7f31e3 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:03.301659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e18ed-69eb-4584-9e5d-189caa914618 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:03.302095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e18ed-69eb-4584-9e5d-189caa914618 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:03.302288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e18ed-69eb-4584-9e5d-189caa914618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:03.453385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-108e18ed-69eb-4584-9e5d-189caa914618 None None] MFA Rules not processed for user `de3ad14b526247d5b60dc22b88b56255`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:03.455189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-108e18ed-69eb-4584-9e5d-189caa914618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:03.730706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 858/1720] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:04.363932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b626-47a0-4ff8-9e86-ca98f26800a3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:04.364866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b626-47a0-4ff8-9e86-ca98f26800a3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:04.365297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b626-47a0-4ff8-9e86-ca98f26800a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:04.420712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e107b626-47a0-4ff8-9e86-ca98f26800a3 None None] MFA Rules not processed for user `1a1f3e1faeba451488854da4236359ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:04.426566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e107b626-47a0-4ff8-9e86-ca98f26800a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:04.569220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e18ed-69eb-4584-9e5d-189caa914618 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:04.572462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-108e18ed-69eb-4584-9e5d-189caa914618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:04.729083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 863/1721] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Aug 1 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:04.843480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e18ed-69eb-4584-9e5d-189caa914618 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:04.869136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107b626-47a0-4ff8-9e86-ca98f26800a3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:04.875146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e107b626-47a0-4ff8-9e86-ca98f26800a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:04.886019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:04.889555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:04.890043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:04.890324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] PATH_INFO: `/v3/projects/5e56c7c0b3ef4ce5a68d3f71ae5608d8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:04.895052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e56c7c0b3ef4ce5a68d3f71ae5608d8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:04.901422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:04.918215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107b626-47a0-4ff8-9e86-ca98f26800a3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:04.960866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b405c5f-2f7b-47d3-abcf-6cfe47e58b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:04.973192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b405c5f-2f7b-47d3-abcf-6cfe47e58b9b service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:04.973875 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b405c5f-2f7b-47d3-abcf-6cfe47e58b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:04.983906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b405c5f-2f7b-47d3-abcf-6cfe47e58b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.016745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b405c5f-2f7b-47d3-abcf-6cfe47e58b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:05.018244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b405c5f-2f7b-47d3-abcf-6cfe47e58b9b service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:05.069760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 864/1722] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:05.072009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b405c5f-2f7b-47d3-abcf-6cfe47e58b9b service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:05.119088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b405c5f-2f7b-47d3-abcf-6cfe47e58b9b service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:05.165248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:05.178201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e56c7c0b3ef4ce5a68d3f71ae5608d8', 'request_id': 'req-10748f19-66cf-49d4-b141-765192105458'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:05.214850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e56c7c0b3ef4ce5a68d3f71ae5608d8', 'request_id': 'req-10748f19-66cf-49d4-b141-765192105458'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:05.273670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e56c7c0b3ef4ce5a68d3f71ae5608d8', 'request_id': 'req-10748f19-66cf-49d4-b141-765192105458'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:05.337554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] The token cache is being invalidate because project 5e56c7c0b3ef4ce5a68d3f71ae5608d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:05.337959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:05.339694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:05.347863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 859/1723] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:04 2022] DELETE /identity/v3/projects/5e56c7c0b3ef4ce5a68d3f71ae5608d8 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:05.348873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:05.361682 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.454847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:05.456318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.456842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.457300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.467285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.515194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:05.521860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:05.554637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 865/1724] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:05.555985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:05.563287 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.618443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10748f19-66cf-49d4-b141-765192105458 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:05.632003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:05.632784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.633073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.633395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.651498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:05.653407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:05.701392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 860/1725] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:05.704418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:05.709331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.714793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:05.802155 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e98fe7-b6a0-46e8-8df8-494e3b749653 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:05.826618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:05.827063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.827640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.828157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.841117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.963538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db534e4e-40d8-41b4-89c4-756975169f13 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:05.994356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:05.995183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.995361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.996298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] PATH_INFO: `/v3/users/af63ec4abdc54dc1b852b8e2271bc6e4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:06.002526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af63ec4abdc54dc1b852b8e2271bc6e4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:06.009147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:06.143186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:06.149795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:06.279594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 866/1726] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:06.295456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:06.310467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:06.341954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af63ec4abdc54dc1b852b8e2271bc6e4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:06.374389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af63ec4abdc54dc1b852b8e2271bc6e4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:06.375180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af63ec4abdc54dc1b852b8e2271bc6e4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:06.461568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156056c-de22-4727-b35e-0eb1b9c69848 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:06.463777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af63ec4abdc54dc1b852b8e2271bc6e4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:06.463777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af63ec4abdc54dc1b852b8e2271bc6e4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:06.479900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:06.497269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:06.502437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:06.506684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:06.506684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] PATH_INFO: `/v3/projects/7b28f6811f2e4ad6ae6f63d8d63c23a9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:06.515868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b28f6811f2e4ad6ae6f63d8d63c23a9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:06.533104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:06.552802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 861/1727] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:05 2022] DELETE /identity/v3/users/af63ec4abdc54dc1b852b8e2271bc6e4 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:06.554640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:06.582646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:06.887863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b28f6811f2e4ad6ae6f63d8d63c23a9', 'request_id': 'req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:06.922701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b28f6811f2e4ad6ae6f63d8d63c23a9', 'request_id': 'req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:06.961446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b28f6811f2e4ad6ae6f63d8d63c23a9', 'request_id': 'req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:07.005688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41ddf-a0de-433f-8969-19d7661fea6d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:07.035934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] The token cache is being invalidate because project 7b28f6811f2e4ad6ae6f63d8d63c23a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:07.036401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:07.063641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4c1c9fc5-8ae8-461a-8718-d8a4e815e953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:07.081803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 867/1728] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:06 2022] DELETE /identity/v3/projects/7b28f6811f2e4ad6ae6f63d8d63c23a9 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:07.093770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1087a9-446f-424f-a38f-2e45bf2e52a2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.094256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1087a9-446f-424f-a38f-2e45bf2e52a2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.094720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1087a9-446f-424f-a38f-2e45bf2e52a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.129152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:07.130625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.131085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.131681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] PATH_INFO: `/v3/projects/a1a5637e6ac04209bb890765d59d7db6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.135318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a5637e6ac04209bb890765d59d7db6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:07.150623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:07.253363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fa1087a9-446f-424f-a38f-2e45bf2e52a2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:07.264988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fa1087a9-446f-424f-a38f-2e45bf2e52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:07.298258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a5637e6ac04209bb890765d59d7db6', 'request_id': 'req-02c096dd-a1f6-446b-b806-49699a383d3f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:07.312029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a5637e6ac04209bb890765d59d7db6', 'request_id': 'req-02c096dd-a1f6-446b-b806-49699a383d3f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:07.349431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a5637e6ac04209bb890765d59d7db6', 'request_id': 'req-02c096dd-a1f6-446b-b806-49699a383d3f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:07.404816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] The token cache is being invalidate because project a1a5637e6ac04209bb890765d59d7db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:07.405309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:07.407800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02c096dd-a1f6-446b-b806-49699a383d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:07.412383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 862/1729] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:06 2022] DELETE /identity/v3/projects/a1a5637e6ac04209bb890765d59d7db6 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:07.421374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade80d-621e-492b-824b-fb11d4d30b7c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.421840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade80d-621e-492b-824b-fb11d4d30b7c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.422417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade80d-621e-492b-824b-fb11d4d30b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.472964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2fade80d-621e-492b-824b-fb11d4d30b7c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:07.475388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2fade80d-621e-492b-824b-fb11d4d30b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:07.548363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:07.590205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 868/1730] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:07.595677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb158-dfb6-4b89-abb3-770ce954b822 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.597308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb158-dfb6-4b89-abb3-770ce954b822 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.597794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb158-dfb6-4b89-abb3-770ce954b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.637420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:07.677963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1dffb158-dfb6-4b89-abb3-770ce954b822 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:07.680052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1dffb158-dfb6-4b89-abb3-770ce954b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:07.701476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 863/1731] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:07.712973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dd6da-fa3a-41b2-ac9c-1504257bf90a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.714861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dd6da-fa3a-41b2-ac9c-1504257bf90a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.719206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dd6da-fa3a-41b2-ac9c-1504257bf90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.723762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 869/1732] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:07.726802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb158-dfb6-4b89-abb3-770ce954b822 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:07.776486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb158-dfb6-4b89-abb3-770ce954b822 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:07.803889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:07.804902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.805727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.806217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.812083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:07.812746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:07.821732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:07.846626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-567dd6da-fa3a-41b2-ac9c-1504257bf90a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:07.852308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-567dd6da-fa3a-41b2-ac9c-1504257bf90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:07.872298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 870/1733] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:07.879789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:07.909026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4e9b7-20c7-419b-a957-b9a90e62827e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:07.911624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 864/1734] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:07.914660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dd6da-fa3a-41b2-ac9c-1504257bf90a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:07.920443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62076d5-c511-466f-ba4f-7a7fac3499cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:07.921145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62076d5-c511-466f-ba4f-7a7fac3499cb admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.921429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62076d5-c511-466f-ba4f-7a7fac3499cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.921701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62076d5-c511-466f-ba4f-7a7fac3499cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.922481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62076d5-c511-466f-ba4f-7a7fac3499cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:07.928554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62076d5-c511-466f-ba4f-7a7fac3499cb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:07.937662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dd6da-fa3a-41b2-ac9c-1504257bf90a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:07.944745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:07.945672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.946146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.946627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.947683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:07.948034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:07.950585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:07.976201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 865/1735] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:07.977635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:07.991311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58693-67f7-4758-8683-171b89195983 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:07.999713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eee63-e437-4ac1-b4f2-8cc3923f1432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.000784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eee63-e437-4ac1-b4f2-8cc3923f1432 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.001099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eee63-e437-4ac1-b4f2-8cc3923f1432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.001406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eee63-e437-4ac1-b4f2-8cc3923f1432 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.002380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eee63-e437-4ac1-b4f2-8cc3923f1432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.004900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eee63-e437-4ac1-b4f2-8cc3923f1432 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.050141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 871/1736] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:07 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:08.054058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62076d5-c511-466f-ba4f-7a7fac3499cb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:08.059694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 866/1737] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:07 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:08.060905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eee63-e437-4ac1-b4f2-8cc3923f1432 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:08.263205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eee63-e437-4ac1-b4f2-8cc3923f1432 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.280873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0e7e-52d7-42cf-bd85-4b6b6df13617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.281725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0e7e-52d7-42cf-bd85-4b6b6df13617 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.282013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0e7e-52d7-42cf-bd85-4b6b6df13617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.282292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0e7e-52d7-42cf-bd85-4b6b6df13617 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.283139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d0e7e-52d7-42cf-bd85-4b6b6df13617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.294174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62076d5-c511-466f-ba4f-7a7fac3499cb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.300073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d0e7e-52d7-42cf-bd85-4b6b6df13617 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.301082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109ffd3-12bd-47a4-af12-ea2fb5d273e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.301729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ffd3-12bd-47a4-af12-ea2fb5d273e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.302011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ffd3-12bd-47a4-af12-ea2fb5d273e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.302294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ffd3-12bd-47a4-af12-ea2fb5d273e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.302967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109ffd3-12bd-47a4-af12-ea2fb5d273e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.307064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109ffd3-12bd-47a4-af12-ea2fb5d273e8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.366514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 872/1738] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:08 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:08.367549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109ffd3-12bd-47a4-af12-ea2fb5d273e8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:08.379717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 867/1739] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:08 2022] POST /identity/v3/users => generated 285 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:08.382947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0e7e-52d7-42cf-bd85-4b6b6df13617 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:08.392278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109ffd3-12bd-47a4-af12-ea2fb5d273e8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.407853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b9d8-b85f-4f8a-a274-a85577557c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.411639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b9d8-b85f-4f8a-a274-a85577557c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.412121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b9d8-b85f-4f8a-a274-a85577557c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.412411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b9d8-b85f-4f8a-a274-a85577557c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.413147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825b9d8-b85f-4f8a-a274-a85577557c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.417191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825b9d8-b85f-4f8a-a274-a85577557c76 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.425461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0e7e-52d7-42cf-bd85-4b6b6df13617 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.441767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a716cf9-d15e-4d14-ab2a-fb0eeae1452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.449352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a716cf9-d15e-4d14-ab2a-fb0eeae1452b admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.449710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a716cf9-d15e-4d14-ab2a-fb0eeae1452b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.449997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a716cf9-d15e-4d14-ab2a-fb0eeae1452b admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.453199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 873/1740] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:08.455948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a716cf9-d15e-4d14-ab2a-fb0eeae1452b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.457623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b9d8-b85f-4f8a-a274-a85577557c76 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:08.461576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a716cf9-d15e-4d14-ab2a-fb0eeae1452b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.489878 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b9d8-b85f-4f8a-a274-a85577557c76 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.512966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 868/1741] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:08.518475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a3bb4-7ee1-48f2-aff3-ebdda3bd092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.518944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a716cf9-d15e-4d14-ab2a-fb0eeae1452b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:08.523012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a3bb4-7ee1-48f2-aff3-ebdda3bd092d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.523606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a3bb4-7ee1-48f2-aff3-ebdda3bd092d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.523903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a3bb4-7ee1-48f2-aff3-ebdda3bd092d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.528290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a3bb4-7ee1-48f2-aff3-ebdda3bd092d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.535695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a3bb4-7ee1-48f2-aff3-ebdda3bd092d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.580010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a716cf9-d15e-4d14-ab2a-fb0eeae1452b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.585833 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5e70-4bd7-43bf-a3bf-4d434f831c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.588531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5e70-4bd7-43bf-a3bf-4d434f831c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.588676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 874/1742] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:08.589053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5e70-4bd7-43bf-a3bf-4d434f831c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.590175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5e70-4bd7-43bf-a3bf-4d434f831c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.590930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d5e70-4bd7-43bf-a3bf-4d434f831c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.591045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a3bb4-7ee1-48f2-aff3-ebdda3bd092d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:08.592615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d5e70-4bd7-43bf-a3bf-4d434f831c65 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.630492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 869/1743] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:08.637189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5e70-4bd7-43bf-a3bf-4d434f831c65 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:08.649072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a3bb4-7ee1-48f2-aff3-ebdda3bd092d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.666274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5e70-4bd7-43bf-a3bf-4d434f831c65 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.671567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8e988-5a9a-4a66-8c9b-2be990789659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.672420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8e988-5a9a-4a66-8c9b-2be990789659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.672701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8e988-5a9a-4a66-8c9b-2be990789659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.672978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8e988-5a9a-4a66-8c9b-2be990789659 admin admin] PATH_INFO: `/v3/projects/862a989ab1854c3c93b5411595d304e9/users/6375d403e9b742a7a7e3aebf413b2dcf/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.682429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06a900-f0c5-4e13-a271-645c124c9bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.683276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a900-f0c5-4e13-a271-645c124c9bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.683643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a900-f0c5-4e13-a271-645c124c9bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.687951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a900-f0c5-4e13-a271-645c124c9bf2 admin admin] PATH_INFO: `/v3/projects/0eab9e0d1e144006bf3e23de06699875/users/75fdeb4039384647a6caf51d6da1afc8/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.703578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8e988-5a9a-4a66-8c9b-2be990789659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=862a989ab1854c3c93b5411595d304e9, user_id=6375d403e9b742a7a7e3aebf413b2dcf, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.706910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8e988-5a9a-4a66-8c9b-2be990789659 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.745439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06a900-f0c5-4e13-a271-645c124c9bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eab9e0d1e144006bf3e23de06699875, user_id=75fdeb4039384647a6caf51d6da1afc8, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.749325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06a900-f0c5-4e13-a271-645c124c9bf2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.760355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 870/1744] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:08 2022] PUT /identity/v3/projects/862a989ab1854c3c93b5411595d304e9/users/6375d403e9b742a7a7e3aebf413b2dcf/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:08.763079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b707-01ff-4750-a592-0a9019fd3c4c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.763317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b707-01ff-4750-a592-0a9019fd3c4c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.763642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b707-01ff-4750-a592-0a9019fd3c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.785657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 875/1745] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:08 2022] PUT /identity/v3/projects/0eab9e0d1e144006bf3e23de06699875/users/75fdeb4039384647a6caf51d6da1afc8/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:08.797391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08cd8c-62da-4e08-bf72-fee675104c9c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.798134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08cd8c-62da-4e08-bf72-fee675104c9c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.799921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08cd8c-62da-4e08-bf72-fee675104c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.847802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0777b707-01ff-4750-a592-0a9019fd3c4c None None] MFA Rules not processed for user `6375d403e9b742a7a7e3aebf413b2dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:08.852223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0777b707-01ff-4750-a592-0a9019fd3c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:08.881113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ec08cd8c-62da-4e08-bf72-fee675104c9c None None] MFA Rules not processed for user `75fdeb4039384647a6caf51d6da1afc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:08.884354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ec08cd8c-62da-4e08-bf72-fee675104c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:08.950977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:09.119526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:09.121413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 871/1746] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:09.126767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b707-01ff-4750-a592-0a9019fd3c4c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:09.158669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 876/1747] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:09.162917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08cd8c-62da-4e08-bf72-fee675104c9c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:09.338388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08cd8c-62da-4e08-bf72-fee675104c9c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:09.364083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b0613-be19-493e-8f40-3bb37cc66a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:09.367654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b0613-be19-493e-8f40-3bb37cc66a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.368469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b0613-be19-493e-8f40-3bb37cc66a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.370105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b0613-be19-493e-8f40-3bb37cc66a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.371869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b0613-be19-493e-8f40-3bb37cc66a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:09.376919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b707-01ff-4750-a592-0a9019fd3c4c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:09.379234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b0613-be19-493e-8f40-3bb37cc66a34 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:09.389983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde3801-47be-45b7-a7d2-5bf6176a4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:09.392119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde3801-47be-45b7-a7d2-5bf6176a4bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.394032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde3801-47be-45b7-a7d2-5bf6176a4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.394720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde3801-47be-45b7-a7d2-5bf6176a4bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.399702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde3801-47be-45b7-a7d2-5bf6176a4bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:09.410210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde3801-47be-45b7-a7d2-5bf6176a4bbd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:09.513210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 877/1748] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:09 2022] POST /identity/v3/projects => generated 387 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:09.517986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b0613-be19-493e-8f40-3bb37cc66a34 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:09.550701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 872/1749] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:09 2022] POST /identity/v3/projects => generated 371 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:09.584794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde3801-47be-45b7-a7d2-5bf6176a4bbd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:09.813873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b0613-be19-493e-8f40-3bb37cc66a34 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:09.936912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde3801-47be-45b7-a7d2-5bf6176a4bbd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:09.949181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c578-d09e-4eda-85c7-7212e60e8697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:09.949864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c578-d09e-4eda-85c7-7212e60e8697 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.950148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c578-d09e-4eda-85c7-7212e60e8697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.950444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c578-d09e-4eda-85c7-7212e60e8697 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.953902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c578-d09e-4eda-85c7-7212e60e8697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:09.959114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c578-d09e-4eda-85c7-7212e60e8697 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.052113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 873/1750] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:09 2022] POST /identity/v3/users => generated 292 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:10.058089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c578-d09e-4eda-85c7-7212e60e8697 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:10.068339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076116a1-d43b-467d-bdad-3db0db4a0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:10.068998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076116a1-d43b-467d-bdad-3db0db4a0122 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.069286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076116a1-d43b-467d-bdad-3db0db4a0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.069607 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076116a1-d43b-467d-bdad-3db0db4a0122 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.070298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076116a1-d43b-467d-bdad-3db0db4a0122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:10.075394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076116a1-d43b-467d-bdad-3db0db4a0122 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.084801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c578-d09e-4eda-85c7-7212e60e8697 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:10.101098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d47fdf-5c74-4f70-a7ee-606bd8687503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:10.101779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d47fdf-5c74-4f70-a7ee-606bd8687503 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.102069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d47fdf-5c74-4f70-a7ee-606bd8687503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.102351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d47fdf-5c74-4f70-a7ee-606bd8687503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.103073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d47fdf-5c74-4f70-a7ee-606bd8687503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:10.104813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d47fdf-5c74-4f70-a7ee-606bd8687503 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.168206 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 878/1751] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:09 2022] POST /identity/v3/users => generated 300 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:10.177236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076116a1-d43b-467d-bdad-3db0db4a0122 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:10.184267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 874/1752] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:10.186611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d47fdf-5c74-4f70-a7ee-606bd8687503 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:10.260188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d47fdf-5c74-4f70-a7ee-606bd8687503 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:10.267642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076116a1-d43b-467d-bdad-3db0db4a0122 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:10.282253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3dcc1-1b22-4497-8a72-ffe961449ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:10.283319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dcc1-1b22-4497-8a72-ffe961449ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.283608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dcc1-1b22-4497-8a72-ffe961449ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.284712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dcc1-1b22-4497-8a72-ffe961449ac5 admin admin] PATH_INFO: `/v3/projects/e90d4c6b1e444ea2936db1f5bd67bbd4/users/af4cdb9cd2a644088ad47736b6588c74/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.287250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d64a0-acfa-4e6f-9522-3259afe82590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:10.288102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d64a0-acfa-4e6f-9522-3259afe82590 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.288707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d64a0-acfa-4e6f-9522-3259afe82590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.289998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d64a0-acfa-4e6f-9522-3259afe82590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.292562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d64a0-acfa-4e6f-9522-3259afe82590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:10.299159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d64a0-acfa-4e6f-9522-3259afe82590 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.348933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3dcc1-1b22-4497-8a72-ffe961449ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90d4c6b1e444ea2936db1f5bd67bbd4, user_id=af4cdb9cd2a644088ad47736b6588c74, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:10.349251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 879/1753] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:10.354852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d64a0-acfa-4e6f-9522-3259afe82590 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:10.361000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3dcc1-1b22-4497-8a72-ffe961449ac5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.396195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d64a0-acfa-4e6f-9522-3259afe82590 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:10.404461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 875/1754] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:10 2022] PUT /identity/v3/projects/e90d4c6b1e444ea2936db1f5bd67bbd4/users/af4cdb9cd2a644088ad47736b6588c74/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:10.412270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3dcc1-1b22-4497-8a72-ffe961449ac5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:10.412803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:10.442154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:10.692070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a716-78d3-4dca-9075-259824a88d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:10.693009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a716-78d3-4dca-9075-259824a88d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.693391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a716-78d3-4dca-9075-259824a88d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.693843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a716-78d3-4dca-9075-259824a88d67 admin admin] PATH_INFO: `/v3/projects/c228be871d1b4cdc9a86177188f349d2/users/c3a3c63a292e449f84f580dca5bc69c6/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.717677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3dcc1-1b22-4497-8a72-ffe961449ac5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:10.738366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d4eb2-abb4-4727-9da3-1a9c7abc5599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:10.739460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d4eb2-abb4-4727-9da3-1a9c7abc5599 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.739460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d4eb2-abb4-4727-9da3-1a9c7abc5599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.739746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d4eb2-abb4-4727-9da3-1a9c7abc5599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.740399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d4eb2-abb4-4727-9da3-1a9c7abc5599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:10.742494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d4eb2-abb4-4727-9da3-1a9c7abc5599 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.787879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 876/1755] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:10.788871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d4eb2-abb4-4727-9da3-1a9c7abc5599 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:10.798572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a716-78d3-4dca-9075-259824a88d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c228be871d1b4cdc9a86177188f349d2, user_id=c3a3c63a292e449f84f580dca5bc69c6, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:10.801615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a716-78d3-4dca-9075-259824a88d67 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.853505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d4eb2-abb4-4727-9da3-1a9c7abc5599 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:10.891889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 880/1756] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:10 2022] PUT /identity/v3/projects/c228be871d1b4cdc9a86177188f349d2/users/c3a3c63a292e449f84f580dca5bc69c6/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:10.904966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a716-78d3-4dca-9075-259824a88d67 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:11.124433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc552b-6bc8-4576-95d6-1812c7ffe113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:11.128200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc552b-6bc8-4576-95d6-1812c7ffe113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:11.130419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc552b-6bc8-4576-95d6-1812c7ffe113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:11.131463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc552b-6bc8-4576-95d6-1812c7ffe113 admin admin] PATH_INFO: `/v3/projects/e90d4c6b1e444ea2936db1f5bd67bbd4/users/af4cdb9cd2a644088ad47736b6588c74/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:11.139898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc552b-6bc8-4576-95d6-1812c7ffe113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90d4c6b1e444ea2936db1f5bd67bbd4, user_id=af4cdb9cd2a644088ad47736b6588c74, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:11.150400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc552b-6bc8-4576-95d6-1812c7ffe113 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:11.171757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a716-78d3-4dca-9075-259824a88d67 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:11.226448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 877/1757] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:10 2022] PUT /identity/v3/projects/e90d4c6b1e444ea2936db1f5bd67bbd4/users/af4cdb9cd2a644088ad47736b6588c74/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:11.232868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd36746-7b37-4cf6-9d06-3497ded0a574 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:11.233189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd36746-7b37-4cf6-9d06-3497ded0a574 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:11.233460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd36746-7b37-4cf6-9d06-3497ded0a574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:11.332245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5fd36746-7b37-4cf6-9d06-3497ded0a574 None None] MFA Rules not processed for user `af4cdb9cd2a644088ad47736b6588c74`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:11.333617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5fd36746-7b37-4cf6-9d06-3497ded0a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:11.522174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa8283-008f-47c1-bc23-51f2f549415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:11.531703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8283-008f-47c1-bc23-51f2f549415a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:11.531986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8283-008f-47c1-bc23-51f2f549415a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:11.532271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8283-008f-47c1-bc23-51f2f549415a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:11.534716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa8283-008f-47c1-bc23-51f2f549415a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:11.539944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa8283-008f-47c1-bc23-51f2f549415a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:11.581012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 881/1758] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 677 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:11.584582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf7c9-a11e-4a2f-adf4-520dffd77d4b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:11.591884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf7c9-a11e-4a2f-adf4-520dffd77d4b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:11.594670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf7c9-a11e-4a2f-adf4-520dffd77d4b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:11.597970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 882/1759] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:38:11 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:38:11.599181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf7c9-a11e-4a2f-adf4-520dffd77d4b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:11.638753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 878/1760] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:11.648273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd36746-7b37-4cf6-9d06-3497ded0a574 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:11.649776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5fd36746-7b37-4cf6-9d06-3497ded0a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:11.653886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf7c9-a11e-4a2f-adf4-520dffd77d4b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:11.675020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e6b1c-11e6-4871-9c66-a044b5aaeda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:11.676231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6b1c-11e6-4871-9c66-a044b5aaeda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:11.676682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6b1c-11e6-4871-9c66-a044b5aaeda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:11.677162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6b1c-11e6-4871-9c66-a044b5aaeda3 admin admin] PATH_INFO: `/v3/projects/c228be871d1b4cdc9a86177188f349d2/users/c3a3c63a292e449f84f580dca5bc69c6/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:11.691705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e6b1c-11e6-4871-9c66-a044b5aaeda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c228be871d1b4cdc9a86177188f349d2, user_id=c3a3c63a292e449f84f580dca5bc69c6, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:11.703338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:11.719594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e6b1c-11e6-4871-9c66-a044b5aaeda3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:11.781483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 883/1761] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:11 2022] PUT /identity/v3/projects/c228be871d1b4cdc9a86177188f349d2/users/c3a3c63a292e449f84f580dca5bc69c6/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:11.796469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340997-de4f-482e-b669-234a52ce219a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:11.797144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340997-de4f-482e-b669-234a52ce219a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:11.797600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340997-de4f-482e-b669-234a52ce219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:11.822953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd36746-7b37-4cf6-9d06-3497ded0a574 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:11.882372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aa340997-de4f-482e-b669-234a52ce219a None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:11.886934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aa340997-de4f-482e-b669-234a52ce219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:11.967295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:12.045490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:12.046630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.048214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.048214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.185474 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 884/1762] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:12.187712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b419-0ab5-4148-a100-a813dee9bb2f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.188346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b419-0ab5-4148-a100-a813dee9bb2f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.190724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b419-0ab5-4148-a100-a813dee9bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.252163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5022b419-0ab5-4148-a100-a813dee9bb2f None None] MFA Rules not processed for user `c3a3c63a292e449f84f580dca5bc69c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:12.253640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5022b419-0ab5-4148-a100-a813dee9bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:12.330065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:12.334753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:12.369795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 879/1763] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:38:12.429685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 885/1764] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:12.449331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:12.479305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:12.568265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224c69e-65b1-4f7a-a781-75fb15bf7f54 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:12.590040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:12.591121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.591842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.592355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.626941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:12.629336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:12.682142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022b419-0ab5-4148-a100-a813dee9bb2f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:12.682586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 880/1765] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:12.725745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022b419-0ab5-4148-a100-a813dee9bb2f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:12.749108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:12.763711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.763862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.764291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.885727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:12.889622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:13.006817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:13.012241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:13.050891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 886/1766] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:13.146019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9ae3-0dcf-4b62-9d1e-55b36372a303 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:13.157371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:13.159355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:13.167962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:13.169094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:13.169586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:13.170081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] PATH_INFO: `/v3/projects/74cb547d63b14531b9aaada3cbf9157c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:13.175659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cb547d63b14531b9aaada3cbf9157c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:13.200890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:13.214655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a62af-6f67-49fe-b6fc-c1caf0ed5e28 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:13.240708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8e023-51e2-4c93-8b89-e9edd2f7cd00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:13.244319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e023-51e2-4c93-8b89-e9edd2f7cd00 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:13.245931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e023-51e2-4c93-8b89-e9edd2f7cd00 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:13.246427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e023-51e2-4c93-8b89-e9edd2f7cd00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:13.277618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:13.321484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8e023-51e2-4c93-8b89-e9edd2f7cd00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:13.353617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8e023-51e2-4c93-8b89-e9edd2f7cd00 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:13.415733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 887/1767] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:13.468541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cb547d63b14531b9aaada3cbf9157c', 'request_id': 'req-157f8039-fdf6-422f-8596-b0bbaea6dc39'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:13.495699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cb547d63b14531b9aaada3cbf9157c', 'request_id': 'req-157f8039-fdf6-422f-8596-b0bbaea6dc39'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:13.509037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cb547d63b14531b9aaada3cbf9157c', 'request_id': 'req-157f8039-fdf6-422f-8596-b0bbaea6dc39'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:13.577743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] The token cache is being invalidate because project 74cb547d63b14531b9aaada3cbf9157c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:13.582235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:13.583755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-157f8039-fdf6-422f-8596-b0bbaea6dc39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:13.589032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 881/1768] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:12 2022] DELETE /identity/v3/projects/74cb547d63b14531b9aaada3cbf9157c => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:13.597303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97073-76b4-4a37-928f-afa8f34da2e1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:13.597882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97073-76b4-4a37-928f-afa8f34da2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:13.598482 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97073-76b4-4a37-928f-afa8f34da2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:13.656378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f2e97073-76b4-4a37-928f-afa8f34da2e1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:13.662891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f2e97073-76b4-4a37-928f-afa8f34da2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:13.759955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:13.977662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 888/1769] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:13.982159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8237db-aca9-44f5-90eb-5cf9eed26cb6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:13.982442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8237db-aca9-44f5-90eb-5cf9eed26cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:13.982866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8237db-aca9-44f5-90eb-5cf9eed26cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.046826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1f8237db-aca9-44f5-90eb-5cf9eed26cb6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:14.048603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1f8237db-aca9-44f5-90eb-5cf9eed26cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:14.085288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 882/1770] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:38:14.092701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e97073-76b4-4a37-928f-afa8f34da2e1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:14.114648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e97073-76b4-4a37-928f-afa8f34da2e1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:14.132715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:14.133394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.133680 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.133959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.140096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:14.140386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:14.143366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:14.219647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 889/1771] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:14.220838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8237db-aca9-44f5-90eb-5cf9eed26cb6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:14.238473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8237db-aca9-44f5-90eb-5cf9eed26cb6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:14.260614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3871e63-6875-4d03-9dab-859d143cddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:14.261511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3871e63-6875-4d03-9dab-859d143cddc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.261950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3871e63-6875-4d03-9dab-859d143cddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.262373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3871e63-6875-4d03-9dab-859d143cddc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.263776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3871e63-6875-4d03-9dab-859d143cddc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:14.265890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3871e63-6875-4d03-9dab-859d143cddc1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:14.333723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 883/1772] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:14 2022] POST /identity/v3/projects => generated 399 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:14.340674 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:14.356733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d815-5256-49f6-8425-45e64e1ad0c4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:14.483634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:14.485285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.486224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.487634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.489348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:14.493554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:14.580585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 890/1773] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:14 2022] POST /identity/v3/users => generated 300 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:14.582151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3871e63-6875-4d03-9dab-859d143cddc1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:14.627043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3871e63-6875-4d03-9dab-859d143cddc1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:14.642125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:14.645641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:14.653807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48be4f-ae77-40f4-ab6d-fb2883e81b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:14.654620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48be4f-ae77-40f4-ab6d-fb2883e81b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.655089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48be4f-ae77-40f4-ab6d-fb2883e81b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.655600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48be4f-ae77-40f4-ab6d-fb2883e81b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.656990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48be4f-ae77-40f4-ab6d-fb2883e81b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:14.659659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48be4f-ae77-40f4-ab6d-fb2883e81b9a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:14.685360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 884/1774] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:14.686228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48be4f-ae77-40f4-ab6d-fb2883e81b9a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:14.694302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1b3f-4632-4784-8039-24d93449d729 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:14.704021 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48be4f-ae77-40f4-ab6d-fb2883e81b9a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:14.709096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:14.710925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.711128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.711473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] PATH_INFO: `/v3/users/75fdeb4039384647a6caf51d6da1afc8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.715072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fdeb4039384647a6caf51d6da1afc8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:14.718762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669ab21-aafa-49cb-a8a4-d744950c2117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:14.719433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669ab21-aafa-49cb-a8a4-d744950c2117 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.719719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669ab21-aafa-49cb-a8a4-d744950c2117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.720040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669ab21-aafa-49cb-a8a4-d744950c2117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.720817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669ab21-aafa-49cb-a8a4-d744950c2117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:14.731008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:14.742487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669ab21-aafa-49cb-a8a4-d744950c2117 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:14.784338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 885/1775] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:38:14.789582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669ab21-aafa-49cb-a8a4-d744950c2117 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:14.806660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fdeb4039384647a6caf51d6da1afc8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:14.814035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669ab21-aafa-49cb-a8a4-d744950c2117 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:14.825558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fdeb4039384647a6caf51d6da1afc8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:14.831579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b106e97-7e31-492e-9a4b-020bedf33e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:14.832262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106e97-7e31-492e-9a4b-020bedf33e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.832545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106e97-7e31-492e-9a4b-020bedf33e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.832815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106e97-7e31-492e-9a4b-020bedf33e70 admin admin] PATH_INFO: `/v3/projects/62356cbe179841d59dd957701949db92/users/c9efc7009ba5444f9a6219b9428f3611/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.850630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fdeb4039384647a6caf51d6da1afc8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:14.851959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fdeb4039384647a6caf51d6da1afc8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:14.863235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b106e97-7e31-492e-9a4b-020bedf33e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62356cbe179841d59dd957701949db92, user_id=c9efc7009ba5444f9a6219b9428f3611, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:14.869768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b106e97-7e31-492e-9a4b-020bedf33e70 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:14.870292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-19e55b4e-2066-4c90-899c-57e153be6e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fdeb4039384647a6caf51d6da1afc8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:14.879175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 891/1776] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:14 2022] DELETE /identity/v3/users/75fdeb4039384647a6caf51d6da1afc8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:14.885482 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6763-3f88-4ed8-beab-87d29ad30125 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.885770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6763-3f88-4ed8-beab-87d29ad30125 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.886252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6763-3f88-4ed8-beab-87d29ad30125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.896895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 886/1777] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:14 2022] PUT /identity/v3/projects/62356cbe179841d59dd957701949db92/users/c9efc7009ba5444f9a6219b9428f3611/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:14.913759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3d1a6763-3f88-4ed8-beab-87d29ad30125 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:14.915064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3d1a6763-3f88-4ed8-beab-87d29ad30125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:14.920038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4a92-ec84-4d7b-a552-b9ab6374c3ba None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:14.920331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4a92-ec84-4d7b-a552-b9ab6374c3ba None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:14.920624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4a92-ec84-4d7b-a552-b9ab6374c3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:14.937180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:14.990428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e22c4a92-ec84-4d7b-a552-b9ab6374c3ba None None] MFA Rules not processed for user `c9efc7009ba5444f9a6219b9428f3611`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:14.993521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e22c4a92-ec84-4d7b-a552-b9ab6374c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:15.146897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 892/1778] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:15.160906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6763-3f88-4ed8-beab-87d29ad30125 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:15.166578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3d1a6763-3f88-4ed8-beab-87d29ad30125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:15.204778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 887/1779] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:38:15.208406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c4a92-ec84-4d7b-a552-b9ab6374c3ba None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:15.215067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e22c4a92-ec84-4d7b-a552-b9ab6374c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:15.258204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c4a92-ec84-4d7b-a552-b9ab6374c3ba None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:15.275049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dcca4-8232-4d99-af1d-209a4c6f4945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:15.276419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dcca4-8232-4d99-af1d-209a4c6f4945 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:15.277481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dcca4-8232-4d99-af1d-209a4c6f4945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:15.277964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dcca4-8232-4d99-af1d-209a4c6f4945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:15.279419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dcca4-8232-4d99-af1d-209a4c6f4945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:15.281889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dcca4-8232-4d99-af1d-209a4c6f4945 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:15.316737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:15.328773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6763-3f88-4ed8-beab-87d29ad30125 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:15.337289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6999e-9cec-426c-b4ac-349d1ca17431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:15.338193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6999e-9cec-426c-b4ac-349d1ca17431 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:15.338531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6999e-9cec-426c-b4ac-349d1ca17431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:15.338813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6999e-9cec-426c-b4ac-349d1ca17431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:15.344621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 888/1780] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:15 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:15.352983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6999e-9cec-426c-b4ac-349d1ca17431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:15.354631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6999e-9cec-426c-b4ac-349d1ca17431 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:15.359332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dcca4-8232-4d99-af1d-209a4c6f4945 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:15.367584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 893/1781] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:15.400618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1096-1c9f-4811-81d4-39f3adec8822 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:15.400990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1096-1c9f-4811-81d4-39f3adec8822 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:15.401525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1096-1c9f-4811-81d4-39f3adec8822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:15.468887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-abcd1096-1c9f-4811-81d4-39f3adec8822 None None] MFA Rules not processed for user `f4fa2b7534d0498f9e30c382e640c878`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:15.478003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-abcd1096-1c9f-4811-81d4-39f3adec8822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:15.670854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dcca4-8232-4d99-af1d-209a4c6f4945 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:15.689851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8956-eb3c-4daa-b8dd-a9e58d06126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:15.690683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8956-eb3c-4daa-b8dd-a9e58d06126f admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:15.692522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8956-eb3c-4daa-b8dd-a9e58d06126f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:15.692797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8956-eb3c-4daa-b8dd-a9e58d06126f admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:15.699178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef8956-eb3c-4daa-b8dd-a9e58d06126f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:15.702527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 894/1782] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:15.709431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef8956-eb3c-4daa-b8dd-a9e58d06126f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:15.748719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 889/1783] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:15 2022] POST /identity/v3/users => generated 307 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:15.757259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd1096-1c9f-4811-81d4-39f3adec8822 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:15.766286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e634e-18fe-4da4-945e-ad035c659f20 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:15.766699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e634e-18fe-4da4-945e-ad035c659f20 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:15.767209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e634e-18fe-4da4-945e-ad035c659f20 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:15.770541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 890/1784] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:38:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:38:15.776947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd1096-1c9f-4811-81d4-39f3adec8822 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:15.783452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253b2e1-782e-4530-8e47-357717f0164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:15.784201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253b2e1-782e-4530-8e47-357717f0164a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:15.784548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253b2e1-782e-4530-8e47-357717f0164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:15.785221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253b2e1-782e-4530-8e47-357717f0164a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:15.787262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253b2e1-782e-4530-8e47-357717f0164a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:15.790537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253b2e1-782e-4530-8e47-357717f0164a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:15.817978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 895/1785] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:15.821788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb9eb-fe98-46e4-8853-aba3be57215c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:15.822555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb9eb-fe98-46e4-8853-aba3be57215c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:15.822995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb9eb-fe98-46e4-8853-aba3be57215c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:15.829709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253b2e1-782e-4530-8e47-357717f0164a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:15.875309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253b2e1-782e-4530-8e47-357717f0164a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:15.882144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-cacdb9eb-fe98-46e4-8853-aba3be57215c None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:15.886636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cacdb9eb-fe98-46e4-8853-aba3be57215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:15.893892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f5aba-20c8-41f7-ad72-a10d69613ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:15.894603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f5aba-20c8-41f7-ad72-a10d69613ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:15.894888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f5aba-20c8-41f7-ad72-a10d69613ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:15.895166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f5aba-20c8-41f7-ad72-a10d69613ede admin admin] PATH_INFO: `/v3/projects/0941c0884cf44b17ba86c426fd4d8c5f/users/2f5b247e56e5448b9c3bb277044f6a39/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:15.922843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f5aba-20c8-41f7-ad72-a10d69613ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=0941c0884cf44b17ba86c426fd4d8c5f, user_id=2f5b247e56e5448b9c3bb277044f6a39, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:15.929638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f5aba-20c8-41f7-ad72-a10d69613ede admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:15.963713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 896/1786] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:15 2022] PUT /identity/v3/projects/0941c0884cf44b17ba86c426fd4d8c5f/users/2f5b247e56e5448b9c3bb277044f6a39/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:15.969134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f5aba-20c8-41f7-ad72-a10d69613ede admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:16.067586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 891/1787] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:16.069216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:16.100490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdb9eb-fe98-46e4-8853-aba3be57215c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:16.102069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cacdb9eb-fe98-46e4-8853-aba3be57215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:16.135217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdb9eb-fe98-46e4-8853-aba3be57215c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:16.144752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:16.145606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:16.145995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:16.146517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] PATH_INFO: `/v3/projects/0eab9e0d1e144006bf3e23de06699875` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:16.148411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eab9e0d1e144006bf3e23de06699875)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:16.157084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f5aba-20c8-41f7-ad72-a10d69613ede admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:16.163877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:16.171516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44d3ce-702a-4fc2-8b13-982504ba4677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:16.172495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d3ce-702a-4fc2-8b13-982504ba4677 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:16.172899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d3ce-702a-4fc2-8b13-982504ba4677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:16.173288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d3ce-702a-4fc2-8b13-982504ba4677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:16.174499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44d3ce-702a-4fc2-8b13-982504ba4677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:16.176716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44d3ce-702a-4fc2-8b13-982504ba4677 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:16.220341 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 897/1788] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:16.222245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44d3ce-702a-4fc2-8b13-982504ba4677 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:16.241015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44d3ce-702a-4fc2-8b13-982504ba4677 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:16.272203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eab9e0d1e144006bf3e23de06699875', 'request_id': 'req-9cd7c21b-ead5-4725-8546-17f2facd9739'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.288367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eab9e0d1e144006bf3e23de06699875', 'request_id': 'req-9cd7c21b-ead5-4725-8546-17f2facd9739'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.311488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eab9e0d1e144006bf3e23de06699875', 'request_id': 'req-9cd7c21b-ead5-4725-8546-17f2facd9739'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.326161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cfd29-e662-45b3-b9a0-51861cd8db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:16.326999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cfd29-e662-45b3-b9a0-51861cd8db9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:16.327294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cfd29-e662-45b3-b9a0-51861cd8db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:16.327816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cfd29-e662-45b3-b9a0-51861cd8db9a admin admin] PATH_INFO: `/v3/projects/0941c0884cf44b17ba86c426fd4d8c5f/users/2f5b247e56e5448b9c3bb277044f6a39/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:16.330333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cfd29-e662-45b3-b9a0-51861cd8db9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0941c0884cf44b17ba86c426fd4d8c5f, user_id=2f5b247e56e5448b9c3bb277044f6a39, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:16.333657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cfd29-e662-45b3-b9a0-51861cd8db9a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:16.351676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 898/1789] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:16 2022] PUT /identity/v3/projects/0941c0884cf44b17ba86c426fd4d8c5f/users/2f5b247e56e5448b9c3bb277044f6a39/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:16.366815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:16.368100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7371-f831-488f-bfaa-ad1f444ae0fe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:16.368396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7371-f831-488f-bfaa-ad1f444ae0fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:16.368679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7371-f831-488f-bfaa-ad1f444ae0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:16.371736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] The token cache is being invalidate because project 0eab9e0d1e144006bf3e23de06699875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:16.373687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.376536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.383483 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 892/1790] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:16 2022] DELETE /identity/v3/projects/0eab9e0d1e144006bf3e23de06699875 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:16.387619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:16.390537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:16.425141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c21b-ead5-4725-8546-17f2facd9739 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:16.434978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b65a7371-f831-488f-bfaa-ad1f444ae0fe None None] MFA Rules not processed for user `2f5b247e56e5448b9c3bb277044f6a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:16.436568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b65a7371-f831-488f-bfaa-ad1f444ae0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:16.623161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:16.623876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:16.624164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:16.624437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] PATH_INFO: `/v3/users/c3a3c63a292e449f84f580dca5bc69c6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:16.632473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 899/1791] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:38:16.632473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a7371-f831-488f-bfaa-ad1f444ae0fe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:16.632732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a3c63a292e449f84f580dca5bc69c6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:16.632815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b65a7371-f831-488f-bfaa-ad1f444ae0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:16.634621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:16.726419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:16.737795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a3c63a292e449f84f580dca5bc69c6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.755462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a3c63a292e449f84f580dca5bc69c6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.756996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a3c63a292e449f84f580dca5bc69c6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.815786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a3c63a292e449f84f580dca5bc69c6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.817180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a3c63a292e449f84f580dca5bc69c6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:16.844471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a7371-f831-488f-bfaa-ad1f444ae0fe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:16.856351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 893/1792] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:16 2022] DELETE /identity/v3/users/c3a3c63a292e449f84f580dca5bc69c6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:16.860087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:16.860973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:16.861788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:16.862141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:16.862593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:16.864735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:16.883173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:16.925963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:16.928401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:16.965883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 900/1793] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:17.061322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350c9e0-fda8-4fad-8dfc-82ee3742dae9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:17.072690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:17.074233 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:17.076730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:17.077892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:17.083869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:17.201347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:17.295476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:17.297546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:17.331117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 894/1794] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:17.462571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:17.630093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b9b1-c87d-4bf1-88c9-5497e30f68f6 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:17.641010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b1292-5417-4fe6-8eeb-a3cf15d03cee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:17.642365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b1292-5417-4fe6-8eeb-a3cf15d03cee service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:17.643584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b1292-5417-4fe6-8eeb-a3cf15d03cee service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:17.644615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b1292-5417-4fe6-8eeb-a3cf15d03cee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:17.648163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ce1b1292-5417-4fe6-8eeb-a3cf15d03cee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:17.796023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b1292-5417-4fe6-8eeb-a3cf15d03cee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:17.799501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b1292-5417-4fe6-8eeb-a3cf15d03cee service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:17.818786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 901/1795] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:18.739871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:18.742911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:18.837254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3fc76-8d73-4a79-9dc2-e845a3b55642 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:18.851764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:18.853008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:18.853153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:18.853312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] PATH_INFO: `/v3/projects/c228be871d1b4cdc9a86177188f349d2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:18.856429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c228be871d1b4cdc9a86177188f349d2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:18.858557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:18.978718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c228be871d1b4cdc9a86177188f349d2', 'request_id': 'req-df358cb2-88d8-43c9-bbb4-038a454bcb93'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:18.998702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c228be871d1b4cdc9a86177188f349d2', 'request_id': 'req-df358cb2-88d8-43c9-bbb4-038a454bcb93'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:19.015180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c228be871d1b4cdc9a86177188f349d2', 'request_id': 'req-df358cb2-88d8-43c9-bbb4-038a454bcb93'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:19.049556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] The token cache is being invalidate because project c228be871d1b4cdc9a86177188f349d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:19.050684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:19.051661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df358cb2-88d8-43c9-bbb4-038a454bcb93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:19.057767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 895/1796] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:18 2022] DELETE /identity/v3/projects/c228be871d1b4cdc9a86177188f349d2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:19.060940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c235-d442-4308-a060-7d5f56257ca2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.061758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c235-d442-4308-a060-7d5f56257ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.061758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c235-d442-4308-a060-7d5f56257ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.110551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1536c235-d442-4308-a060-7d5f56257ca2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:19.123068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1536c235-d442-4308-a060-7d5f56257ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:19.267435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a54f6-775c-43dd-8b34-ac5ab28976cd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.279602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a54f6-775c-43dd-8b34-ac5ab28976cd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.279602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a54f6-775c-43dd-8b34-ac5ab28976cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.316166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d95a54f6-775c-43dd-8b34-ac5ab28976cd None None] MFA Rules not processed for user `de3ad14b526247d5b60dc22b88b56255`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:19.320237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d95a54f6-775c-43dd-8b34-ac5ab28976cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:19.326954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 902/1797] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:38:19.337438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea893-5c67-412a-b9f7-9e15aa2b45d5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.337438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea893-5c67-412a-b9f7-9e15aa2b45d5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.337438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea893-5c67-412a-b9f7-9e15aa2b45d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.379580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2a5ea893-5c67-412a-b9f7-9e15aa2b45d5 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:19.386716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2a5ea893-5c67-412a-b9f7-9e15aa2b45d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:19.408057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 903/1798] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:19.412492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ea893-5c67-412a-b9f7-9e15aa2b45d5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:19.438288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ea893-5c67-412a-b9f7-9e15aa2b45d5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:19.449148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 896/1799] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:19.451801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:19.453171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.453553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.453909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.455021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:19.455480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:19.457558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:19.468723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:19.477461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 904/1800] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:19.478944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a54f6-775c-43dd-8b34-ac5ab28976cd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:19.489562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:19.494941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a54f6-775c-43dd-8b34-ac5ab28976cd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:19.503004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66c85d-3d26-4a60-85ba-6f8b57224c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:19.504399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c85d-3d26-4a60-85ba-6f8b57224c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.504845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c85d-3d26-4a60-85ba-6f8b57224c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.505256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c85d-3d26-4a60-85ba-6f8b57224c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.506721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66c85d-3d26-4a60-85ba-6f8b57224c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:19.509578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66c85d-3d26-4a60-85ba-6f8b57224c26 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:19.599724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 897/1801] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:19 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:19.603865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:19.617133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632f0d5-d602-4519-8533-e43e2b24dde8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:19.715080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be180ce-a685-427c-bdea-79cc6b269fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:19.716005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be180ce-a685-427c-bdea-79cc6b269fab admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.716427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be180ce-a685-427c-bdea-79cc6b269fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.717043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be180ce-a685-427c-bdea-79cc6b269fab admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.717789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be180ce-a685-427c-bdea-79cc6b269fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:19.721362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be180ce-a685-427c-bdea-79cc6b269fab admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:19.752428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 905/1802] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:19 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:19.757504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66c85d-3d26-4a60-85ba-6f8b57224c26 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:19.777160 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66c85d-3d26-4a60-85ba-6f8b57224c26 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:19.785966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c344d-3059-4529-9940-1a7766c77274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:19.789251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c344d-3059-4529-9940-1a7766c77274 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.789544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c344d-3059-4529-9940-1a7766c77274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.789828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c344d-3059-4529-9940-1a7766c77274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.790563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c344d-3059-4529-9940-1a7766c77274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:19.798734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c344d-3059-4529-9940-1a7766c77274 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:19.822271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 898/1803] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:19.828419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be180ce-a685-427c-bdea-79cc6b269fab admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:19.840788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be180ce-a685-427c-bdea-79cc6b269fab admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:19.847245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6f527-a186-4bc1-8653-9cd5f480188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:19.848077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6f527-a186-4bc1-8653-9cd5f480188b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.848430 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6f527-a186-4bc1-8653-9cd5f480188b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.848777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6f527-a186-4bc1-8653-9cd5f480188b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.849570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6f527-a186-4bc1-8653-9cd5f480188b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:19.851286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6f527-a186-4bc1-8653-9cd5f480188b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:19.871446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 906/1804] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:38:19.872962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c344d-3059-4529-9940-1a7766c77274 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:19.888848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c344d-3059-4529-9940-1a7766c77274 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:19.895386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:19.896321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.897353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.897353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] PATH_INFO: `/v3/projects/59d4107cbf18451da9a12ebcb8e658b7/users/1514be6039114439ad057297371e8698/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:19.917343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d4107cbf18451da9a12ebcb8e658b7, user_id=1514be6039114439ad057297371e8698, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:19.921032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:19.947506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 899/1805] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:19 2022] PUT /identity/v3/projects/59d4107cbf18451da9a12ebcb8e658b7/users/1514be6039114439ad057297371e8698/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:19.961236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11335-b10c-41bb-888c-d3acb85fb70e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:19.961921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11335-b10c-41bb-888c-d3acb85fb70e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:19.962836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11335-b10c-41bb-888c-d3acb85fb70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:20.015058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-70f11335-b10c-41bb-888c-d3acb85fb70e None None] MFA Rules not processed for user `1514be6039114439ad057297371e8698`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:20.022105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-70f11335-b10c-41bb-888c-d3acb85fb70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:20.110147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 907/1806] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:20.123977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:20.126002 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:20.225775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1335e7-70ab-4455-ade6-3e960151c85e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:20.243437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a77f02-2e92-4a10-8a04-7d7176c06ccb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03250eb151044619c0f720f315b8509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:20.243437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a77f02-2e92-4a10-8a04-7d7176c06ccb service glance] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:20.243437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a77f02-2e92-4a10-8a04-7d7176c06ccb service glance] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:20.243437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a77f02-2e92-4a10-8a04-7d7176c06ccb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:20.248592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a77f02-2e92-4a10-8a04-7d7176c06ccb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:20.251173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a77f02-2e92-4a10-8a04-7d7176c06ccb service glance] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:20.268962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 900/1807] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:22.771237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f11335-b10c-41bb-888c-d3acb85fb70e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:22.772829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-70f11335-b10c-41bb-888c-d3acb85fb70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:22.970179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f11335-b10c-41bb-888c-d3acb85fb70e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:23.017394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:23.021523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:23.023414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:23.024317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] PATH_INFO: `/v3/users/c9efc7009ba5444f9a6219b9428f3611` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:23.033717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9efc7009ba5444f9a6219b9428f3611)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:23.041392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:23.107217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:23.214500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9efc7009ba5444f9a6219b9428f3611'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:23.270967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9efc7009ba5444f9a6219b9428f3611'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:23.288337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9efc7009ba5444f9a6219b9428f3611'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:23.289387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9efc7009ba5444f9a6219b9428f3611'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:23.310427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9efc7009ba5444f9a6219b9428f3611'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:23.318024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 908/1808] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:22 2022] DELETE /identity/v3/users/c9efc7009ba5444f9a6219b9428f3611 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:23.322980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300da27-4929-4f03-af53-fb3e74d6cd8c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:23.324049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300da27-4929-4f03-af53-fb3e74d6cd8c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:23.324568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300da27-4929-4f03-af53-fb3e74d6cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:23.346726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d300da27-4929-4f03-af53-fb3e74d6cd8c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:23.348258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d300da27-4929-4f03-af53-fb3e74d6cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:23.473907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 901/1809] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:23.524626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:23.531632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:23.643760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98cb9e-94d0-441f-aa02-122594f0b1cc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:23.648860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235766d3-8ea7-4ff7-841e-8146259fcba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:23.649059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235766d3-8ea7-4ff7-841e-8146259fcba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:23.649475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235766d3-8ea7-4ff7-841e-8146259fcba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:23.649752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235766d3-8ea7-4ff7-841e-8146259fcba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:23.663311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235766d3-8ea7-4ff7-841e-8146259fcba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:23.665021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235766d3-8ea7-4ff7-841e-8146259fcba7 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:23.678241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 909/1810] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:24.084066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300da27-4929-4f03-af53-fb3e74d6cd8c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:24.086525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d300da27-4929-4f03-af53-fb3e74d6cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:24.106710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300da27-4929-4f03-af53-fb3e74d6cd8c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:24.118927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:24.121721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:24.122588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:24.123679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] PATH_INFO: `/v3/projects/62356cbe179841d59dd957701949db92` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:24.128137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62356cbe179841d59dd957701949db92)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:24.131939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:24.187899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:24.227889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62356cbe179841d59dd957701949db92', 'request_id': 'req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.235775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62356cbe179841d59dd957701949db92', 'request_id': 'req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.254048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62356cbe179841d59dd957701949db92', 'request_id': 'req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.277701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] The token cache is being invalidate because project 62356cbe179841d59dd957701949db92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:24.278298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.279318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.286512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235766d3-8ea7-4ff7-841e-8146259fcba7 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:24.295484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 902/1811] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:24 2022] DELETE /identity/v3/projects/62356cbe179841d59dd957701949db92 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:24.332786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235766d3-8ea7-4ff7-841e-8146259fcba7 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:24.476213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:24.477405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:24.477890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:24.478380 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] PATH_INFO: `/v3/users/2f5b247e56e5448b9c3bb277044f6a39` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:24.480367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5b247e56e5448b9c3bb277044f6a39)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:24.488666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:24.541194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:24.589581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5b247e56e5448b9c3bb277044f6a39'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.600964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5b247e56e5448b9c3bb277044f6a39'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.610605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5b247e56e5448b9c3bb277044f6a39'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.611458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5b247e56e5448b9c3bb277044f6a39'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.630189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bfdd864-ed25-4987-a38c-683677610d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5b247e56e5448b9c3bb277044f6a39'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:24.642309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 910/1812] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:24 2022] DELETE /identity/v3/users/2f5b247e56e5448b9c3bb277044f6a39 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:25.075823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:25.077403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:25.095506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6afb4-ab31-4ccf-be80-0d170b6381c8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:25.122865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fba38-5c0d-48be-8434-7a54b34d31ba None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.123326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fba38-5c0d-48be-8434-7a54b34d31ba None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.123666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fba38-5c0d-48be-8434-7a54b34d31ba None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.125660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 911/1813] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:38:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:38:25.150920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ba208-8b02-4178-b3fe-fe1acd4f68f3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.151253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ba208-8b02-4178-b3fe-fe1acd4f68f3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.151822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ba208-8b02-4178-b3fe-fe1acd4f68f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.204935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-af2ba208-8b02-4178-b3fe-fe1acd4f68f3 None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:25.206439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-af2ba208-8b02-4178-b3fe-fe1acd4f68f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:25.229392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:25.231480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.243415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.250117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] PATH_INFO: `/v3/projects/0941c0884cf44b17ba86c426fd4d8c5f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.256616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0941c0884cf44b17ba86c426fd4d8c5f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:25.260191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:25.318904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 912/1814] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:25.338043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ba208-8b02-4178-b3fe-fe1acd4f68f3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:25.340458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-af2ba208-8b02-4178-b3fe-fe1acd4f68f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:25.342085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0941c0884cf44b17ba86c426fd4d8c5f', 'request_id': 'req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:25.361043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0941c0884cf44b17ba86c426fd4d8c5f', 'request_id': 'req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:25.363913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ba208-8b02-4178-b3fe-fe1acd4f68f3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:25.393558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0941c0884cf44b17ba86c426fd4d8c5f', 'request_id': 'req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:25.413439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] The token cache is being invalidate because project 0941c0884cf44b17ba86c426fd4d8c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:25.413727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:25.414380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15c4ec19-b69c-46ee-90dc-6d6d7453ba02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:25.415968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 903/1815] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:25 2022] DELETE /identity/v3/projects/0941c0884cf44b17ba86c426fd4d8c5f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:25.421710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac96cc-9324-4aed-b0f0-5a6c075e383c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.421966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac96cc-9324-4aed-b0f0-5a6c075e383c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.422251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac96cc-9324-4aed-b0f0-5a6c075e383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.446742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f5ac96cc-9324-4aed-b0f0-5a6c075e383c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:25.448084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f5ac96cc-9324-4aed-b0f0-5a6c075e383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:25.467691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dcbf4-e8bb-4a5c-9869-29a4daa131fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:25.468865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dcbf4-e8bb-4a5c-9869-29a4daa131fa service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.469124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dcbf4-e8bb-4a5c-9869-29a4daa131fa service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.469584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dcbf4-e8bb-4a5c-9869-29a4daa131fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.472708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ef9dcbf4-e8bb-4a5c-9869-29a4daa131fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:25.503274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dcbf4-e8bb-4a5c-9869-29a4daa131fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:25.503274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dcbf4-e8bb-4a5c-9869-29a4daa131fa service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:25.520256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:25.523681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 913/1816] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:25.563477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 904/1817] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:25.571898 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e3ff-1a2a-495d-b162-3c0292210028 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.572115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e3ff-1a2a-495d-b162-3c0292210028 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.572365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e3ff-1a2a-495d-b162-3c0292210028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.598958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8937e3ff-1a2a-495d-b162-3c0292210028 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:25.600571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8937e3ff-1a2a-495d-b162-3c0292210028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:25.612330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 914/1818] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:38:25.617987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac96cc-9324-4aed-b0f0-5a6c075e383c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:25.635134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac96cc-9324-4aed-b0f0-5a6c075e383c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:25.641570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:25.642397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.642629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.642893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.643680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:25.644010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:25.646018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:25.666702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 905/1819] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:25.668824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937e3ff-1a2a-495d-b162-3c0292210028 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:25.681233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937e3ff-1a2a-495d-b162-3c0292210028 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:25.688295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6f390-020d-4863-80db-a8a18158fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:25.689202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6f390-020d-4863-80db-a8a18158fd5f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.689492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6f390-020d-4863-80db-a8a18158fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.689773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6f390-020d-4863-80db-a8a18158fd5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.690464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6f390-020d-4863-80db-a8a18158fd5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:25.693128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6f390-020d-4863-80db-a8a18158fd5f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:25.733638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:25.748226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 915/1820] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:25 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:25.753196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:25.784295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1dff9-ae96-405c-9fbd-578bcb687c05 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:25.922905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a6d2-78ba-4699-b448-8be5bd0ea6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:25.923770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a6d2-78ba-4699-b448-8be5bd0ea6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:25.924387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a6d2-78ba-4699-b448-8be5bd0ea6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:25.924745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a6d2-78ba-4699-b448-8be5bd0ea6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:25.925676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728a6d2-78ba-4699-b448-8be5bd0ea6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:25.929622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728a6d2-78ba-4699-b448-8be5bd0ea6a4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:25.977959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 906/1821] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:25 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:25.982191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6f390-020d-4863-80db-a8a18158fd5f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:25.999277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6f390-020d-4863-80db-a8a18158fd5f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.008316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd1f05-c246-4c0e-855f-2fc64c9bf005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.009137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd1f05-c246-4c0e-855f-2fc64c9bf005 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.009548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd1f05-c246-4c0e-855f-2fc64c9bf005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.009854 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd1f05-c246-4c0e-855f-2fc64c9bf005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.010572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd1f05-c246-4c0e-855f-2fc64c9bf005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.012927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd1f05-c246-4c0e-855f-2fc64c9bf005 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.038808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 916/1822] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:26.043687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a6d2-78ba-4699-b448-8be5bd0ea6a4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:26.085810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a6d2-78ba-4699-b448-8be5bd0ea6a4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.093006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03156ce-2b22-4da1-bf5e-f3ce71f00e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.093681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03156ce-2b22-4da1-bf5e-f3ce71f00e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.094030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03156ce-2b22-4da1-bf5e-f3ce71f00e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.094309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03156ce-2b22-4da1-bf5e-f3ce71f00e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.094949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03156ce-2b22-4da1-bf5e-f3ce71f00e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.096918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03156ce-2b22-4da1-bf5e-f3ce71f00e63 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.120933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 907/1823] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:26.127360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd1f05-c246-4c0e-855f-2fc64c9bf005 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:26.152822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd1f05-c246-4c0e-855f-2fc64c9bf005 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.163574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31f29-2db5-41fb-8974-8cac9c4fc8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.164930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31f29-2db5-41fb-8974-8cac9c4fc8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.165990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31f29-2db5-41fb-8974-8cac9c4fc8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.166542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31f29-2db5-41fb-8974-8cac9c4fc8e0 admin admin] PATH_INFO: `/v3/projects/7cc495230fc34d78ad1328d71402e0b4/users/ca9218ce0d6745819d875ff94660a23a/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.196653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b31f29-2db5-41fb-8974-8cac9c4fc8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc495230fc34d78ad1328d71402e0b4, user_id=ca9218ce0d6745819d875ff94660a23a, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.200367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b31f29-2db5-41fb-8974-8cac9c4fc8e0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.221417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 917/1824] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:26 2022] PUT /identity/v3/projects/7cc495230fc34d78ad1328d71402e0b4/users/ca9218ce0d6745819d875ff94660a23a/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:26.226574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310960-6f77-4402-ad94-28d56b941078 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.226863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310960-6f77-4402-ad94-28d56b941078 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.227189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310960-6f77-4402-ad94-28d56b941078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.272209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-04310960-6f77-4402-ad94-28d56b941078 None None] MFA Rules not processed for user `ca9218ce0d6745819d875ff94660a23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:26.273453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-04310960-6f77-4402-ad94-28d56b941078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:26.360203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 908/1825] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:26.364788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31f29-2db5-41fb-8974-8cac9c4fc8e0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:26.450132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31f29-2db5-41fb-8974-8cac9c4fc8e0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.455014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c5897-ec56-4828-8ef4-110363823969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.455697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c5897-ec56-4828-8ef4-110363823969 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.456013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c5897-ec56-4828-8ef4-110363823969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.456264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c5897-ec56-4828-8ef4-110363823969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.456956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c5897-ec56-4828-8ef4-110363823969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.458903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c5897-ec56-4828-8ef4-110363823969 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.492118 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 918/1826] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:26 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:26.500252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310960-6f77-4402-ad94-28d56b941078 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:26.522159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310960-6f77-4402-ad94-28d56b941078 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.618251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:26.653546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47835a65-12eb-4ee9-b35b-8f8e831369db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.654179 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835a65-12eb-4ee9-b35b-8f8e831369db admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.654458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835a65-12eb-4ee9-b35b-8f8e831369db admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.654729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835a65-12eb-4ee9-b35b-8f8e831369db admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.655566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835a65-12eb-4ee9-b35b-8f8e831369db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.657746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835a65-12eb-4ee9-b35b-8f8e831369db admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.681547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 909/1827] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:26 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:26.686226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c5897-ec56-4828-8ef4-110363823969 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:26.697930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c5897-ec56-4828-8ef4-110363823969 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.703985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b374534-92b9-4b4b-bc4b-393c1ef21cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.704602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374534-92b9-4b4b-bc4b-393c1ef21cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.705055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374534-92b9-4b4b-bc4b-393c1ef21cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.705334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374534-92b9-4b4b-bc4b-393c1ef21cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.706112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b374534-92b9-4b4b-bc4b-393c1ef21cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.707744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b374534-92b9-4b4b-bc4b-393c1ef21cf6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.718825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 919/1828] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:26.723171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47835a65-12eb-4ee9-b35b-8f8e831369db admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:26.734906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47835a65-12eb-4ee9-b35b-8f8e831369db admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.739920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c969-390e-4ee7-815a-fef2aebbe6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.740589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c969-390e-4ee7-815a-fef2aebbe6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.740869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c969-390e-4ee7-815a-fef2aebbe6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.741143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c969-390e-4ee7-815a-fef2aebbe6bb admin admin] PATH_INFO: `/v3/projects/2375ab3ca7604e3aa1ed0a78c04ec684/users/f34a5bccfc20493faa6931be5bd1df20/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.765122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1c969-390e-4ee7-815a-fef2aebbe6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2375ab3ca7604e3aa1ed0a78c04ec684, user_id=f34a5bccfc20493faa6931be5bd1df20, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.767996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1c969-390e-4ee7-815a-fef2aebbe6bb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.781748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 910/1829] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:26 2022] PUT /identity/v3/projects/2375ab3ca7604e3aa1ed0a78c04ec684/users/f34a5bccfc20493faa6931be5bd1df20/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:26.786548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b374534-92b9-4b4b-bc4b-393c1ef21cf6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:26.797354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b374534-92b9-4b4b-bc4b-393c1ef21cf6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.859532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ac4d2-3cf0-4753-850b-c7f18efcb3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.860159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ac4d2-3cf0-4753-850b-c7f18efcb3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.860439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ac4d2-3cf0-4753-850b-c7f18efcb3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.860713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ac4d2-3cf0-4753-850b-c7f18efcb3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.861402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ac4d2-3cf0-4753-850b-c7f18efcb3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.863541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ac4d2-3cf0-4753-850b-c7f18efcb3bf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.875636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 920/1830] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:26.880030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c969-390e-4ee7-815a-fef2aebbe6bb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:26.895231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c969-390e-4ee7-815a-fef2aebbe6bb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:26.900855 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:26.902129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.903186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.903514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] PATH_INFO: `/v3/projects/2375ab3ca7604e3aa1ed0a78c04ec684/users/f34a5bccfc20493faa6931be5bd1df20/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:26.905627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2375ab3ca7604e3aa1ed0a78c04ec684, user_id=f34a5bccfc20493faa6931be5bd1df20, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:26.908516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:26.925875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 911/1831] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:26 2022] PUT /identity/v3/projects/2375ab3ca7604e3aa1ed0a78c04ec684/users/f34a5bccfc20493faa6931be5bd1df20/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:26.940090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b368-606a-47c5-92e8-08f5a27d5a8c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:26.940787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b368-606a-47c5-92e8-08f5a27d5a8c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:26.941480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b368-606a-47c5-92e8-08f5a27d5a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:27.006946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-66a7b368-606a-47c5-92e8-08f5a27d5a8c None None] MFA Rules not processed for user `f34a5bccfc20493faa6931be5bd1df20`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:27.010950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-66a7b368-606a-47c5-92e8-08f5a27d5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:27.097575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:27.241636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 921/1832] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:27.255681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:27.261200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:27.465258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bb49e-341e-4313-8e9e-aafe1c502c4f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:27.472082 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca0643-22ca-4e7a-ac74-78f6e64227c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:27.472733 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca0643-22ca-4e7a-ac74-78f6e64227c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:27.473017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca0643-22ca-4e7a-ac74-78f6e64227c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:27.473298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca0643-22ca-4e7a-ac74-78f6e64227c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:27.491114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca0643-22ca-4e7a-ac74-78f6e64227c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:27.494010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca0643-22ca-4e7a-ac74-78f6e64227c9 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:27.511413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 912/1833] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:27.952994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b368-606a-47c5-92e8-08f5a27d5a8c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:28.149403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b368-606a-47c5-92e8-08f5a27d5a8c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:28.163978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:28.165068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:28.165425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:28.165897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] PATH_INFO: `/v3/users/ca9218ce0d6745819d875ff94660a23a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:28.167628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9218ce0d6745819d875ff94660a23a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:28.169728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:28.252248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9218ce0d6745819d875ff94660a23a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:28.281492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9218ce0d6745819d875ff94660a23a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:28.322381 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9218ce0d6745819d875ff94660a23a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:28.325088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9218ce0d6745819d875ff94660a23a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:28.364219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9218ce0d6745819d875ff94660a23a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:28.395996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 922/1834] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:27 2022] DELETE /identity/v3/users/ca9218ce0d6745819d875ff94660a23a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:28.396195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64163d4-69e9-4ef4-b734-33336cf53bb0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:28.396650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64163d4-69e9-4ef4-b734-33336cf53bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:28.396650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64163d4-69e9-4ef4-b734-33336cf53bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:28.428950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f64163d4-69e9-4ef4-b734-33336cf53bb0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:28.430320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f64163d4-69e9-4ef4-b734-33336cf53bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:28.516579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 913/1835] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:28.553851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:28.555326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:28.638605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:28.676873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12cbc-ec10-4de6-94e3-4f99bdc69532 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:28.688091 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f619a2-0564-4883-9800-2e8682a7c591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:28.688968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f619a2-0564-4883-9800-2e8682a7c591 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:28.689349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f619a2-0564-4883-9800-2e8682a7c591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:28.689639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f619a2-0564-4883-9800-2e8682a7c591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:28.705245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f619a2-0564-4883-9800-2e8682a7c591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:28.707595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f619a2-0564-4883-9800-2e8682a7c591 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:28.726397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 923/1836] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:30.318098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64163d4-69e9-4ef4-b734-33336cf53bb0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:30.319997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f64163d4-69e9-4ef4-b734-33336cf53bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:30.332917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64163d4-69e9-4ef4-b734-33336cf53bb0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:30.338473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:30.339273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:30.339717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:30.339986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] PATH_INFO: `/v3/projects/7cc495230fc34d78ad1328d71402e0b4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:30.348792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc495230fc34d78ad1328d71402e0b4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:30.352045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:30.399337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:30.456528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc495230fc34d78ad1328d71402e0b4', 'request_id': 'req-8544e0ab-d453-4715-acbf-8b6e8524991c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.469215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc495230fc34d78ad1328d71402e0b4', 'request_id': 'req-8544e0ab-d453-4715-acbf-8b6e8524991c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.493025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc495230fc34d78ad1328d71402e0b4', 'request_id': 'req-8544e0ab-d453-4715-acbf-8b6e8524991c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.511659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] The token cache is being invalidate because project 7cc495230fc34d78ad1328d71402e0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:30.512055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.512970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.514710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 914/1837] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:30 2022] DELETE /identity/v3/projects/7cc495230fc34d78ad1328d71402e0b4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:30.522368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f619a2-0564-4883-9800-2e8682a7c591 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:30.535245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f619a2-0564-4883-9800-2e8682a7c591 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:30.694810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:30.695635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:30.696012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:30.697099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] PATH_INFO: `/v3/users/f34a5bccfc20493faa6931be5bd1df20` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:30.697786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34a5bccfc20493faa6931be5bd1df20)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:30.700416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:30.811616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34a5bccfc20493faa6931be5bd1df20'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.824698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34a5bccfc20493faa6931be5bd1df20'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.834146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34a5bccfc20493faa6931be5bd1df20'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.834993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34a5bccfc20493faa6931be5bd1df20'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.850661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cabdd33f-220a-4411-a5c1-b438b272a8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34a5bccfc20493faa6931be5bd1df20'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:30.861466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 924/1838] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:30 2022] DELETE /identity/v3/users/f34a5bccfc20493faa6931be5bd1df20 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:31.319692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:31.323363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:31.354546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544e0ab-d453-4715-acbf-8b6e8524991c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:31.431891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:31.433552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:31.433952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:31.434310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] PATH_INFO: `/v3/projects/2375ab3ca7604e3aa1ed0a78c04ec684` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:31.437373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2375ab3ca7604e3aa1ed0a78c04ec684)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:31.440864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:31.518615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2375ab3ca7604e3aa1ed0a78c04ec684', 'request_id': 'req-bcd3e033-1be3-454c-ac5c-8c24362b31a9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:31.529593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2375ab3ca7604e3aa1ed0a78c04ec684', 'request_id': 'req-bcd3e033-1be3-454c-ac5c-8c24362b31a9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:31.557987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2375ab3ca7604e3aa1ed0a78c04ec684', 'request_id': 'req-bcd3e033-1be3-454c-ac5c-8c24362b31a9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:31.591953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] The token cache is being invalidate because project 2375ab3ca7604e3aa1ed0a78c04ec684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:31.592602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:31.593677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bcd3e033-1be3-454c-ac5c-8c24362b31a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:31.596681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 915/1839] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:31 2022] DELETE /identity/v3/projects/2375ab3ca7604e3aa1ed0a78c04ec684 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:31.603451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae9db0-7aec-4afe-b715-b2453922f56c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:31.604097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae9db0-7aec-4afe-b715-b2453922f56c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:31.604097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae9db0-7aec-4afe-b715-b2453922f56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:31.644323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1aae9db0-7aec-4afe-b715-b2453922f56c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:31.645612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1aae9db0-7aec-4afe-b715-b2453922f56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:31.736821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:31.749198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 925/1840] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:31.756952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a4e2-a62d-406d-8a25-e7f04f902cbe None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:31.757268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a4e2-a62d-406d-8a25-e7f04f902cbe None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:31.757517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a4e2-a62d-406d-8a25-e7f04f902cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:31.783058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9482a4e2-a62d-406d-8a25-e7f04f902cbe None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:31.784564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9482a4e2-a62d-406d-8a25-e7f04f902cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:31.798626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 916/1841] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:31.806909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae9db0-7aec-4afe-b715-b2453922f56c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:31.820866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae9db0-7aec-4afe-b715-b2453922f56c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:31.827405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:31.828079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:31.828372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:31.828671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:31.829858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:31.830176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:31.832520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:31.851035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 926/1842] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:31.855620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482a4e2-a62d-406d-8a25-e7f04f902cbe None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:31.865638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482a4e2-a62d-406d-8a25-e7f04f902cbe None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:31.877624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e22b4f-8ba1-4ae8-b04b-706ce0a0a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:31.878281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e22b4f-8ba1-4ae8-b04b-706ce0a0a347 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:31.878570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e22b4f-8ba1-4ae8-b04b-706ce0a0a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:31.878856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e22b4f-8ba1-4ae8-b04b-706ce0a0a347 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:31.879727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e22b4f-8ba1-4ae8-b04b-706ce0a0a347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:31.881677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e22b4f-8ba1-4ae8-b04b-706ce0a0a347 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:31.913650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 917/1843] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:31 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:31.918327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:31.930546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120bc81-3ede-4460-94eb-e654204aab59 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:32.079114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561038f-379a-4b36-91ea-06a55cef7aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:32.079725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561038f-379a-4b36-91ea-06a55cef7aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:32.080008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561038f-379a-4b36-91ea-06a55cef7aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:32.080290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561038f-379a-4b36-91ea-06a55cef7aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:32.081451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561038f-379a-4b36-91ea-06a55cef7aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:32.083818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561038f-379a-4b36-91ea-06a55cef7aeb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:32.126863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 927/1844] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:31 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:32.131670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e22b4f-8ba1-4ae8-b04b-706ce0a0a347 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:32.150999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e22b4f-8ba1-4ae8-b04b-706ce0a0a347 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:32.194920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e9b5-aec3-4d1d-97e3-7102d9051fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:32.195799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e9b5-aec3-4d1d-97e3-7102d9051fef admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:32.196153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e9b5-aec3-4d1d-97e3-7102d9051fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:32.197048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e9b5-aec3-4d1d-97e3-7102d9051fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:32.199682 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262e9b5-aec3-4d1d-97e3-7102d9051fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:32.201932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262e9b5-aec3-4d1d-97e3-7102d9051fef admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:32.235963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 918/1845] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:38:32.250342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561038f-379a-4b36-91ea-06a55cef7aeb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:32.272458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561038f-379a-4b36-91ea-06a55cef7aeb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:32.286810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dff58-78a0-4e7d-83be-3490ef1894bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:32.287926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dff58-78a0-4e7d-83be-3490ef1894bc admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:32.292147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dff58-78a0-4e7d-83be-3490ef1894bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:32.292147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dff58-78a0-4e7d-83be-3490ef1894bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:32.296556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dff58-78a0-4e7d-83be-3490ef1894bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:32.300296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dff58-78a0-4e7d-83be-3490ef1894bc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:32.342625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e9b5-aec3-4d1d-97e3-7102d9051fef admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:32.371460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 928/1846] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:32.371823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e9b5-aec3-4d1d-97e3-7102d9051fef admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:32.382496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919012aa-4c41-4a0f-848f-753402f1c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:32.383637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919012aa-4c41-4a0f-848f-753402f1c8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:32.385171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919012aa-4c41-4a0f-848f-753402f1c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:32.385527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919012aa-4c41-4a0f-848f-753402f1c8b5 admin admin] PATH_INFO: `/v3/projects/18177244297c4d5f8485db6169755b84/users/134818217fec4fd8800c654e4c8d802a/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:32.396148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:32.433482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919012aa-4c41-4a0f-848f-753402f1c8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18177244297c4d5f8485db6169755b84, user_id=134818217fec4fd8800c654e4c8d802a, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:32.436493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919012aa-4c41-4a0f-848f-753402f1c8b5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:32.475685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 919/1847] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:32 2022] PUT /identity/v3/projects/18177244297c4d5f8485db6169755b84/users/134818217fec4fd8800c654e4c8d802a/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:32.488056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd020d-1954-4e52-b72a-0bcca772e435 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:32.490289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd020d-1954-4e52-b72a-0bcca772e435 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:32.490894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd020d-1954-4e52-b72a-0bcca772e435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:32.557571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5bfd020d-1954-4e52-b72a-0bcca772e435 None None] MFA Rules not processed for user `134818217fec4fd8800c654e4c8d802a`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:32.564691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5bfd020d-1954-4e52-b72a-0bcca772e435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:32.673179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 929/1848] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:32.678493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919012aa-4c41-4a0f-848f-753402f1c8b5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:32.769799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919012aa-4c41-4a0f-848f-753402f1c8b5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:32.776134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774cabe-97fe-4848-a3e9-dc076ab9b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:32.776890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774cabe-97fe-4848-a3e9-dc076ab9b79c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:32.777181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774cabe-97fe-4848-a3e9-dc076ab9b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:32.777463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774cabe-97fe-4848-a3e9-dc076ab9b79c admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:32.778186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774cabe-97fe-4848-a3e9-dc076ab9b79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:32.781014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774cabe-97fe-4848-a3e9-dc076ab9b79c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:32.814449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 920/1849] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:32 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:32.818543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd020d-1954-4e52-b72a-0bcca772e435 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:32.829987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd020d-1954-4e52-b72a-0bcca772e435 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:32.912541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:32.923677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac1e47-1855-45f0-9806-98a0874106b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:32.926193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac1e47-1855-45f0-9806-98a0874106b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:32.926939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac1e47-1855-45f0-9806-98a0874106b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:32.927584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac1e47-1855-45f0-9806-98a0874106b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:32.929981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac1e47-1855-45f0-9806-98a0874106b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:32.934813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac1e47-1855-45f0-9806-98a0874106b5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:32.996278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 930/1850] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:32 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:32.998845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774cabe-97fe-4848-a3e9-dc076ab9b79c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.019628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774cabe-97fe-4848-a3e9-dc076ab9b79c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.026058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059ace-dec6-4bf9-b478-ee720a031c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.028362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059ace-dec6-4bf9-b478-ee720a031c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.028913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059ace-dec6-4bf9-b478-ee720a031c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.029244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059ace-dec6-4bf9-b478-ee720a031c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.030150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21059ace-dec6-4bf9-b478-ee720a031c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.031971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21059ace-dec6-4bf9-b478-ee720a031c58 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.047138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 921/1851] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:33.052962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac1e47-1855-45f0-9806-98a0874106b5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.071683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac1e47-1855-45f0-9806-98a0874106b5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.079507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa447c6d-cc4d-4045-a33f-2eec763d1d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.080229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447c6d-cc4d-4045-a33f-2eec763d1d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.080418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447c6d-cc4d-4045-a33f-2eec763d1d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.080696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447c6d-cc4d-4045-a33f-2eec763d1d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.081408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa447c6d-cc4d-4045-a33f-2eec763d1d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.083087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa447c6d-cc4d-4045-a33f-2eec763d1d3c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.101917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 931/1852] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:33.102621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059ace-dec6-4bf9-b478-ee720a031c58 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.114862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059ace-dec6-4bf9-b478-ee720a031c58 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.126725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44036c3-62a8-479a-8350-f71e6ea1fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.128207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44036c3-62a8-479a-8350-f71e6ea1fceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.128741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44036c3-62a8-479a-8350-f71e6ea1fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.129225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44036c3-62a8-479a-8350-f71e6ea1fceb admin admin] PATH_INFO: `/v3/projects/9009353a82b440e8a0251fd53679d2a6/users/c0346d31bbe74ebeaf2716484711996d/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.157493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44036c3-62a8-479a-8350-f71e6ea1fceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9009353a82b440e8a0251fd53679d2a6, user_id=c0346d31bbe74ebeaf2716484711996d, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.161107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44036c3-62a8-479a-8350-f71e6ea1fceb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.189759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 922/1853] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:33 2022] PUT /identity/v3/projects/9009353a82b440e8a0251fd53679d2a6/users/c0346d31bbe74ebeaf2716484711996d/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:33.200664 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191a33-06eb-4092-a5cd-8bf4babfafe3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.200954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191a33-06eb-4092-a5cd-8bf4babfafe3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.201235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191a33-06eb-4092-a5cd-8bf4babfafe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.243700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f2191a33-06eb-4092-a5cd-8bf4babfafe3 None None] MFA Rules not processed for user `c0346d31bbe74ebeaf2716484711996d`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:33.245028 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f2191a33-06eb-4092-a5cd-8bf4babfafe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:33.336262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 932/1854] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:33.341865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44036c3-62a8-479a-8350-f71e6ea1fceb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.425679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44036c3-62a8-479a-8350-f71e6ea1fceb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.431020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad765b5e-1363-44b3-8d6b-b40df5f55e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.431810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad765b5e-1363-44b3-8d6b-b40df5f55e6c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.432266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad765b5e-1363-44b3-8d6b-b40df5f55e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.432677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad765b5e-1363-44b3-8d6b-b40df5f55e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.433579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad765b5e-1363-44b3-8d6b-b40df5f55e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.435941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad765b5e-1363-44b3-8d6b-b40df5f55e6c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.476357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 923/1855] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:33 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:33.484907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2191a33-06eb-4092-a5cd-8bf4babfafe3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.500838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2191a33-06eb-4092-a5cd-8bf4babfafe3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.599091 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001eb50-a629-4a65-82c8-75c7e2b83abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.600392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001eb50-a629-4a65-82c8-75c7e2b83abf admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.600912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001eb50-a629-4a65-82c8-75c7e2b83abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.601967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001eb50-a629-4a65-82c8-75c7e2b83abf admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.602819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001eb50-a629-4a65-82c8-75c7e2b83abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.605884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001eb50-a629-4a65-82c8-75c7e2b83abf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.648967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 933/1856] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:33 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:33.650029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad765b5e-1363-44b3-8d6b-b40df5f55e6c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.664750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad765b5e-1363-44b3-8d6b-b40df5f55e6c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.669631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636fbe1-326a-4659-bc4e-78f67ae79e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.670278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636fbe1-326a-4659-bc4e-78f67ae79e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.670577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636fbe1-326a-4659-bc4e-78f67ae79e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.670843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636fbe1-326a-4659-bc4e-78f67ae79e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.671590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636fbe1-326a-4659-bc4e-78f67ae79e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.673408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636fbe1-326a-4659-bc4e-78f67ae79e0e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.688615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 924/1857] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:33.693709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001eb50-a629-4a65-82c8-75c7e2b83abf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.707776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001eb50-a629-4a65-82c8-75c7e2b83abf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.715424 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c4f87-bb31-4d42-a316-0e47c237f836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.716150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c4f87-bb31-4d42-a316-0e47c237f836 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.716439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c4f87-bb31-4d42-a316-0e47c237f836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.716726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c4f87-bb31-4d42-a316-0e47c237f836 admin admin] PATH_INFO: `/v3/projects/42423b2cee3a4b8697b584980f64a3a1/users/77085aa6cfd044c48798b0a02991dc42/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.733453 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c4f87-bb31-4d42-a316-0e47c237f836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42423b2cee3a4b8697b584980f64a3a1, user_id=77085aa6cfd044c48798b0a02991dc42, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.736207 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c4f87-bb31-4d42-a316-0e47c237f836 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.759934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 934/1858] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:33 2022] PUT /identity/v3/projects/42423b2cee3a4b8697b584980f64a3a1/users/77085aa6cfd044c48798b0a02991dc42/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:33.764795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636fbe1-326a-4659-bc4e-78f67ae79e0e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.777957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636fbe1-326a-4659-bc4e-78f67ae79e0e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.784843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:33.856575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc852fbd-434a-4813-b046-eb5e37ef8978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.857207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc852fbd-434a-4813-b046-eb5e37ef8978 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.857486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc852fbd-434a-4813-b046-eb5e37ef8978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.857762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc852fbd-434a-4813-b046-eb5e37ef8978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.858487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc852fbd-434a-4813-b046-eb5e37ef8978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.860178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc852fbd-434a-4813-b046-eb5e37ef8978 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.873111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 925/1859] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:33.877275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c4f87-bb31-4d42-a316-0e47c237f836 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.890470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c4f87-bb31-4d42-a316-0e47c237f836 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.895760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.896468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.896756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.897042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] PATH_INFO: `/v3/projects/42423b2cee3a4b8697b584980f64a3a1/users/77085aa6cfd044c48798b0a02991dc42/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.899697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42423b2cee3a4b8697b584980f64a3a1, user_id=77085aa6cfd044c48798b0a02991dc42, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.902319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.917055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 935/1860] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:33 2022] PUT /identity/v3/projects/42423b2cee3a4b8697b584980f64a3a1/users/77085aa6cfd044c48798b0a02991dc42/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:33.929874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c6c1f-47c1-42e8-9676-8c418bcd39d3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.930970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c6c1f-47c1-42e8-9676-8c418bcd39d3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.931469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c6c1f-47c1-42e8-9676-8c418bcd39d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.987427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-906c6c1f-47c1-42e8-9676-8c418bcd39d3 None None] MFA Rules not processed for user `77085aa6cfd044c48798b0a02991dc42`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:33.988633 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-906c6c1f-47c1-42e8-9676-8c418bcd39d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:34.126991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 926/1861] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:34.151569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:34.154735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:34.192364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:34.250472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d4956-7852-4c25-9b16-d8016a85cc31 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:34.260425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951060d-0252-4375-b58a-f04396e4eac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:34.261659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951060d-0252-4375-b58a-f04396e4eac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:34.262460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951060d-0252-4375-b58a-f04396e4eac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:34.262460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951060d-0252-4375-b58a-f04396e4eac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:34.272681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951060d-0252-4375-b58a-f04396e4eac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:34.274163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951060d-0252-4375-b58a-f04396e4eac9 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:34.285509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 936/1862] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:34.330080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c6c1f-47c1-42e8-9676-8c418bcd39d3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:34.331565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-906c6c1f-47c1-42e8-9676-8c418bcd39d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:34.345217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c6c1f-47c1-42e8-9676-8c418bcd39d3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:34.349615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d9182-8859-479e-bb15-4d28761c7ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:34.350265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d9182-8859-479e-bb15-4d28761c7ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:34.350677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d9182-8859-479e-bb15-4d28761c7ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:34.350841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d9182-8859-479e-bb15-4d28761c7ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:34.420325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d9182-8859-479e-bb15-4d28761c7ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:34.421892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d9182-8859-479e-bb15-4d28761c7ed2 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:34.433860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 927/1863] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:37.741906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951060d-0252-4375-b58a-f04396e4eac9 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:37.827221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951060d-0252-4375-b58a-f04396e4eac9 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:37.831969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:37.832620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:37.832900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:37.833175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] PATH_INFO: `/v3/users/134818217fec4fd8800c654e4c8d802a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:37.834352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134818217fec4fd8800c654e4c8d802a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:37.836344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:37.903943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134818217fec4fd8800c654e4c8d802a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:37.919113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134818217fec4fd8800c654e4c8d802a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:37.929523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134818217fec4fd8800c654e4c8d802a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:37.931533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134818217fec4fd8800c654e4c8d802a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:37.976946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134818217fec4fd8800c654e4c8d802a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:37.990995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 937/1864] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:37 2022] DELETE /identity/v3/users/134818217fec4fd8800c654e4c8d802a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:37.999936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140cc3c-dc58-4e34-968c-9b642be6138d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:38.000916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140cc3c-dc58-4e34-968c-9b642be6138d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:38.000916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140cc3c-dc58-4e34-968c-9b642be6138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:38.024812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c140cc3c-dc58-4e34-968c-9b642be6138d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:38.026028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c140cc3c-dc58-4e34-968c-9b642be6138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:38.063542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:38.122873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 928/1865] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:38.135296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:38.137205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:38.187299 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:38.210878 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c54b7-08eb-465d-a1ca-4aba82cf1e87 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:38.215349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0b4c3-c18a-4444-94cc-50352511f206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:38.216007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0b4c3-c18a-4444-94cc-50352511f206 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:38.216292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0b4c3-c18a-4444-94cc-50352511f206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:38.216577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0b4c3-c18a-4444-94cc-50352511f206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:38.226142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0b4c3-c18a-4444-94cc-50352511f206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:38.227634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0b4c3-c18a-4444-94cc-50352511f206 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:38.238374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 938/1866] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:38.576679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140cc3c-dc58-4e34-968c-9b642be6138d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:38.578413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c140cc3c-dc58-4e34-968c-9b642be6138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:38.608934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140cc3c-dc58-4e34-968c-9b642be6138d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:38.615996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:38.617392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:38.617805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:38.618150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] PATH_INFO: `/v3/projects/18177244297c4d5f8485db6169755b84` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:38.619492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=18177244297c4d5f8485db6169755b84)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:38.622469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:38.710227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18177244297c4d5f8485db6169755b84', 'request_id': 'req-5ebe012f-e54b-4c54-bca5-1983a16bf7be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:38.721452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18177244297c4d5f8485db6169755b84', 'request_id': 'req-5ebe012f-e54b-4c54-bca5-1983a16bf7be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:38.733721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18177244297c4d5f8485db6169755b84', 'request_id': 'req-5ebe012f-e54b-4c54-bca5-1983a16bf7be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:38.764320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] The token cache is being invalidate because project 18177244297c4d5f8485db6169755b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:38.764986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:38.768213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:38.770568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 929/1867] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:38 2022] DELETE /identity/v3/projects/18177244297c4d5f8485db6169755b84 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:38.774615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0b4c3-c18a-4444-94cc-50352511f206 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:38.791192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0b4c3-c18a-4444-94cc-50352511f206 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:38.911719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:38.912152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:38.912528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:38.913741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] PATH_INFO: `/v3/users/c0346d31bbe74ebeaf2716484711996d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:38.930395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0346d31bbe74ebeaf2716484711996d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:38.932563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:39.054236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0346d31bbe74ebeaf2716484711996d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.070551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0346d31bbe74ebeaf2716484711996d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.088358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0346d31bbe74ebeaf2716484711996d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.091593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0346d31bbe74ebeaf2716484711996d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.115427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0346d31bbe74ebeaf2716484711996d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.127671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 939/1868] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:38 2022] DELETE /identity/v3/users/c0346d31bbe74ebeaf2716484711996d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:39.577197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:39.578707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:39.608233 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe012f-e54b-4c54-bca5-1983a16bf7be admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:39.670430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:39.671090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:39.671548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:39.671823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] PATH_INFO: `/v3/projects/9009353a82b440e8a0251fd53679d2a6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:39.672993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9009353a82b440e8a0251fd53679d2a6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:39.675222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:39.724182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9009353a82b440e8a0251fd53679d2a6', 'request_id': 'req-2cbfc14c-463e-47cd-80ed-e31e1813557c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.730530 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9009353a82b440e8a0251fd53679d2a6', 'request_id': 'req-2cbfc14c-463e-47cd-80ed-e31e1813557c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.731816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:39.737490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9009353a82b440e8a0251fd53679d2a6', 'request_id': 'req-2cbfc14c-463e-47cd-80ed-e31e1813557c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.755019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] The token cache is being invalidate because project 9009353a82b440e8a0251fd53679d2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:39.755317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.756047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.757931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 930/1869] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:39 2022] DELETE /identity/v3/projects/9009353a82b440e8a0251fd53679d2a6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:39.762371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:39.763787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:39.776673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8de1-1570-47ab-a488-6ca01e16b6d4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:39.864481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:39.865340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:39.865627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:39.865934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] PATH_INFO: `/v3/users/77085aa6cfd044c48798b0a02991dc42` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:39.867829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=77085aa6cfd044c48798b0a02991dc42)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:39.871106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:39.875188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:39.946049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77085aa6cfd044c48798b0a02991dc42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.956771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77085aa6cfd044c48798b0a02991dc42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.964436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77085aa6cfd044c48798b0a02991dc42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.965366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77085aa6cfd044c48798b0a02991dc42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.978318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba79e8a5-337a-49cf-941a-2919f33d12fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77085aa6cfd044c48798b0a02991dc42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:39.987494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 940/1870] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:39 2022] DELETE /identity/v3/users/77085aa6cfd044c48798b0a02991dc42 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:40.400496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:40.402868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:40.419365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc14c-463e-47cd-80ed-e31e1813557c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:40.504187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:40.504848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:40.505132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:40.505408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] PATH_INFO: `/v3/projects/42423b2cee3a4b8697b584980f64a3a1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:40.506578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42423b2cee3a4b8697b584980f64a3a1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:40.508547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:40.558754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42423b2cee3a4b8697b584980f64a3a1', 'request_id': 'req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:40.565721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42423b2cee3a4b8697b584980f64a3a1', 'request_id': 'req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:40.571740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42423b2cee3a4b8697b584980f64a3a1', 'request_id': 'req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:40.584355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] The token cache is being invalidate because project 42423b2cee3a4b8697b584980f64a3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:40.585029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:40.585404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-44bc8ab4-b10f-4e74-95b9-f558efc3eb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:40.586928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 931/1871] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:40 2022] DELETE /identity/v3/projects/42423b2cee3a4b8697b584980f64a3a1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:40.596158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9d8e7-5fe5-45de-be50-f52c262ccdc8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:40.597494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9d8e7-5fe5-45de-be50-f52c262ccdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:40.597494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9d8e7-5fe5-45de-be50-f52c262ccdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:40.618511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-73c9d8e7-5fe5-45de-be50-f52c262ccdc8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:40.619888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-73c9d8e7-5fe5-45de-be50-f52c262ccdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:40.686398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 941/1872] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:40.702651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6041d-daa6-4d9a-889e-c294b46460cb None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:40.703051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6041d-daa6-4d9a-889e-c294b46460cb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:40.703432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6041d-daa6-4d9a-889e-c294b46460cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:40.727609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-eba6041d-daa6-4d9a-889e-c294b46460cb None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:40.728834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-eba6041d-daa6-4d9a-889e-c294b46460cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:40.736945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 932/1873] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:40.741554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9d8e7-5fe5-45de-be50-f52c262ccdc8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:40.751683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9d8e7-5fe5-45de-be50-f52c262ccdc8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:40.757540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:40.758515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:40.758980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:40.759496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:40.761289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:40.761835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:40.764616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:40.783340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 942/1874] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:38:40.789327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6041d-daa6-4d9a-889e-c294b46460cb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:40.802905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6041d-daa6-4d9a-889e-c294b46460cb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:40.808111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9912436-b8a3-4c72-ba92-b20fed5eadc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:40.808757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9912436-b8a3-4c72-ba92-b20fed5eadc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:40.809044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9912436-b8a3-4c72-ba92-b20fed5eadc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:40.809322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9912436-b8a3-4c72-ba92-b20fed5eadc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:40.810047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9912436-b8a3-4c72-ba92-b20fed5eadc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:40.812068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9912436-b8a3-4c72-ba92-b20fed5eadc4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:40.843581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 933/1875] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:40 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:40.848213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:40.887212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2197-b5b1-42d9-8739-3e8945ab694f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.121154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0c816-8229-4e04-9c17-f24be7c78f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.122063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0c816-8229-4e04-9c17-f24be7c78f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.122623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0c816-8229-4e04-9c17-f24be7c78f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.127695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0c816-8229-4e04-9c17-f24be7c78f58 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.129549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0c816-8229-4e04-9c17-f24be7c78f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.132108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0c816-8229-4e04-9c17-f24be7c78f58 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.153691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:41.171251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 943/1876] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:40 2022] POST /identity/v3/users => generated 291 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:41.176794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9912436-b8a3-4c72-ba92-b20fed5eadc4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:41.196123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9912436-b8a3-4c72-ba92-b20fed5eadc4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.205077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10d77-3d95-4541-a748-bcdb4d3544e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.206109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10d77-3d95-4541-a748-bcdb4d3544e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.206576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10d77-3d95-4541-a748-bcdb4d3544e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.207034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10d77-3d95-4541-a748-bcdb4d3544e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.208381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10d77-3d95-4541-a748-bcdb4d3544e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.211522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10d77-3d95-4541-a748-bcdb4d3544e7 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.234918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 934/1877] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:41.243046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0c816-8229-4e04-9c17-f24be7c78f58 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:41.262574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0c816-8229-4e04-9c17-f24be7c78f58 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.268959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954dda2-0662-4449-a55b-9770e655b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.269600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954dda2-0662-4449-a55b-9770e655b4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.269883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954dda2-0662-4449-a55b-9770e655b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.270157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954dda2-0662-4449-a55b-9770e655b4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.270967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954dda2-0662-4449-a55b-9770e655b4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.272658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954dda2-0662-4449-a55b-9770e655b4d0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.290540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 944/1878] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:41.294218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10d77-3d95-4541-a748-bcdb4d3544e7 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:41.306797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10d77-3d95-4541-a748-bcdb4d3544e7 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.315790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b2385-1fe9-41cf-bf46-9a1b05719dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.316982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2385-1fe9-41cf-bf46-9a1b05719dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.317642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2385-1fe9-41cf-bf46-9a1b05719dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.318134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2385-1fe9-41cf-bf46-9a1b05719dc9 admin admin] PATH_INFO: `/v3/projects/2d1fcc6a494f4882b2b2490c0d996f98/users/9ffb444e7e064f568e1f490dced95e87/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.347502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b2385-1fe9-41cf-bf46-9a1b05719dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1fcc6a494f4882b2b2490c0d996f98, user_id=9ffb444e7e064f568e1f490dced95e87, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.352834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b2385-1fe9-41cf-bf46-9a1b05719dc9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.399401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 935/1879] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:41 2022] PUT /identity/v3/projects/2d1fcc6a494f4882b2b2490c0d996f98/users/9ffb444e7e064f568e1f490dced95e87/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:41.409834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ced178-9dab-4ece-8458-b788ea608208 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.410307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ced178-9dab-4ece-8458-b788ea608208 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.410766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ced178-9dab-4ece-8458-b788ea608208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.469005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-38ced178-9dab-4ece-8458-b788ea608208 None None] MFA Rules not processed for user `9ffb444e7e064f568e1f490dced95e87`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:41.470331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-38ced178-9dab-4ece-8458-b788ea608208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:41.603703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 945/1880] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:41.613972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b2385-1fe9-41cf-bf46-9a1b05719dc9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:41.627571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:41.705640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b2385-1fe9-41cf-bf46-9a1b05719dc9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.711585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a85dc-7782-4193-8a73-a5befc6aa20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.712295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a85dc-7782-4193-8a73-a5befc6aa20d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.712582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a85dc-7782-4193-8a73-a5befc6aa20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.712983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a85dc-7782-4193-8a73-a5befc6aa20d admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.714085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a85dc-7782-4193-8a73-a5befc6aa20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.716163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a85dc-7782-4193-8a73-a5befc6aa20d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.758083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 936/1881] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:41 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:41.764009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ced178-9dab-4ece-8458-b788ea608208 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:41.785659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ced178-9dab-4ece-8458-b788ea608208 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.848659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3376-1c27-4efc-a6d3-9588a284f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.849197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3376-1c27-4efc-a6d3-9588a284f97c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.849493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3376-1c27-4efc-a6d3-9588a284f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.849771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3376-1c27-4efc-a6d3-9588a284f97c admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.850461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c3376-1c27-4efc-a6d3-9588a284f97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.852435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c3376-1c27-4efc-a6d3-9588a284f97c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.878428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 946/1882] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:41 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:41.882894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a85dc-7782-4193-8a73-a5befc6aa20d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:41.894229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a85dc-7782-4193-8a73-a5befc6aa20d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.899007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078c23-7892-4ef3-ab2a-23da746145a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.899677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078c23-7892-4ef3-ab2a-23da746145a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.899965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078c23-7892-4ef3-ab2a-23da746145a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.900400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078c23-7892-4ef3-ab2a-23da746145a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.901737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078c23-7892-4ef3-ab2a-23da746145a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.903288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078c23-7892-4ef3-ab2a-23da746145a9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.916376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 937/1883] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:41.922497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3376-1c27-4efc-a6d3-9588a284f97c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:41.939426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3376-1c27-4efc-a6d3-9588a284f97c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.945407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01b31b-8307-417f-aafc-defae5d1841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.946236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01b31b-8307-417f-aafc-defae5d1841b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.946528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01b31b-8307-417f-aafc-defae5d1841b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.946813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01b31b-8307-417f-aafc-defae5d1841b admin admin] PATH_INFO: `/v3/projects/d23994c826bf415b9e2e3b1690ddedec/users/e4b6a8f0225941b28869586a67113497/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.966954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01b31b-8307-417f-aafc-defae5d1841b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23994c826bf415b9e2e3b1690ddedec, user_id=e4b6a8f0225941b28869586a67113497, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.971480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01b31b-8307-417f-aafc-defae5d1841b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.988722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 947/1884] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:41 2022] PUT /identity/v3/projects/d23994c826bf415b9e2e3b1690ddedec/users/e4b6a8f0225941b28869586a67113497/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:41.995074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078c23-7892-4ef3-ab2a-23da746145a9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:42.008432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078c23-7892-4ef3-ab2a-23da746145a9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:42.170300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f98c9-d853-454a-a2a7-32871d5b7b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:42.171241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f98c9-d853-454a-a2a7-32871d5b7b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:42.171736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f98c9-d853-454a-a2a7-32871d5b7b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:42.172348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f98c9-d853-454a-a2a7-32871d5b7b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:42.173494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f98c9-d853-454a-a2a7-32871d5b7b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:42.176276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f98c9-d853-454a-a2a7-32871d5b7b68 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:42.195359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 938/1885] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:42.200137 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01b31b-8307-417f-aafc-defae5d1841b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:42.221115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01b31b-8307-417f-aafc-defae5d1841b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:42.226201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:42.227192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:42.227508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:42.227871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] PATH_INFO: `/v3/projects/d23994c826bf415b9e2e3b1690ddedec/users/e4b6a8f0225941b28869586a67113497/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:42.230924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23994c826bf415b9e2e3b1690ddedec, user_id=e4b6a8f0225941b28869586a67113497, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:42.234182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:42.260165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 948/1886] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:42 2022] PUT /identity/v3/projects/d23994c826bf415b9e2e3b1690ddedec/users/e4b6a8f0225941b28869586a67113497/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:42.271331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89993eb4-6d2e-4cc3-b703-51e212a953d4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:42.271664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89993eb4-6d2e-4cc3-b703-51e212a953d4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:42.271905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89993eb4-6d2e-4cc3-b703-51e212a953d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:42.305265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-89993eb4-6d2e-4cc3-b703-51e212a953d4 None None] MFA Rules not processed for user `e4b6a8f0225941b28869586a67113497`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:42.306496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-89993eb4-6d2e-4cc3-b703-51e212a953d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:42.404629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 939/1887] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:42.422019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:42.425444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:42.472739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:42.520958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f25db2-042d-4cc4-80b2-cf7859790b04 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:42.528086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09d9c-a10c-4b19-9e98-617474561355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:42.528743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09d9c-a10c-4b19-9e98-617474561355 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:42.529026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09d9c-a10c-4b19-9e98-617474561355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:42.529305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09d9c-a10c-4b19-9e98-617474561355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:42.542340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf09d9c-a10c-4b19-9e98-617474561355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:42.544457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf09d9c-a10c-4b19-9e98-617474561355 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:42.558730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 949/1888] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:43.130228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89993eb4-6d2e-4cc3-b703-51e212a953d4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:43.142100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:43.239512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89993eb4-6d2e-4cc3-b703-51e212a953d4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:43.247011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:43.248084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:43.248537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:43.249011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] PATH_INFO: `/v3/users/9ffb444e7e064f568e1f490dced95e87` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:43.251046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ffb444e7e064f568e1f490dced95e87)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:43.254709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:43.305601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ffb444e7e064f568e1f490dced95e87'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:43.315466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ffb444e7e064f568e1f490dced95e87'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:43.316139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ffb444e7e064f568e1f490dced95e87'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:43.330581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ffb444e7e064f568e1f490dced95e87'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:43.331313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ffb444e7e064f568e1f490dced95e87'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:43.345169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 940/1889] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:43 2022] DELETE /identity/v3/users/9ffb444e7e064f568e1f490dced95e87 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:43.350186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59897-bac2-450c-bc82-99d77b26ac62 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:43.350648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59897-bac2-450c-bc82-99d77b26ac62 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:43.350738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59897-bac2-450c-bc82-99d77b26ac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:43.370526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b0b59897-bac2-450c-bc82-99d77b26ac62 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:43.371815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b0b59897-bac2-450c-bc82-99d77b26ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:43.436222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 950/1890] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:43.447744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:43.450220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:43.514267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ad167-7bd5-4eef-b161-320e4bb8758c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:43.518352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddf404-2e94-4c1d-8f18-bab183e6dc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:43.518928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf404-2e94-4c1d-8f18-bab183e6dc98 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:43.519208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf404-2e94-4c1d-8f18-bab183e6dc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:43.519501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf404-2e94-4c1d-8f18-bab183e6dc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:43.530983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddf404-2e94-4c1d-8f18-bab183e6dc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:43.532397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddf404-2e94-4c1d-8f18-bab183e6dc98 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:43.542255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 941/1891] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:38:43.966044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b59897-bac2-450c-bc82-99d77b26ac62 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:43.967361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b0b59897-bac2-450c-bc82-99d77b26ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:43.986439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b59897-bac2-450c-bc82-99d77b26ac62 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:43.993072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:43.993738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:43.994015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:43.994288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] PATH_INFO: `/v3/projects/2d1fcc6a494f4882b2b2490c0d996f98` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:43.996103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1fcc6a494f4882b2b2490c0d996f98)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:43.998033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:44.050333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1fcc6a494f4882b2b2490c0d996f98', 'request_id': 'req-6e900001-4ad2-409a-932c-d3cef4de5647'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.058277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1fcc6a494f4882b2b2490c0d996f98', 'request_id': 'req-6e900001-4ad2-409a-932c-d3cef4de5647'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.063922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1fcc6a494f4882b2b2490c0d996f98', 'request_id': 'req-6e900001-4ad2-409a-932c-d3cef4de5647'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.074852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] The token cache is being invalidate because project 2d1fcc6a494f4882b2b2490c0d996f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:44.075140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.075806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.077319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 951/1892] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:43 2022] DELETE /identity/v3/projects/2d1fcc6a494f4882b2b2490c0d996f98 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:44.081487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddf404-2e94-4c1d-8f18-bab183e6dc98 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:44.092114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddf404-2e94-4c1d-8f18-bab183e6dc98 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:44.121993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:44.155212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:44.156060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:44.156350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:44.156630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] PATH_INFO: `/v3/users/e4b6a8f0225941b28869586a67113497` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:44.157835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b6a8f0225941b28869586a67113497)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:44.159816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:44.231613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b6a8f0225941b28869586a67113497'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.250030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b6a8f0225941b28869586a67113497'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.250861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b6a8f0225941b28869586a67113497'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.283692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b6a8f0225941b28869586a67113497'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.283692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-26702b39-fbb1-4724-944c-2bbaff3f8158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b6a8f0225941b28869586a67113497'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.305505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 942/1893] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:44 2022] DELETE /identity/v3/users/e4b6a8f0225941b28869586a67113497 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:44.699665 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:44.701344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:44.723531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e900001-4ad2-409a-932c-d3cef4de5647 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:44.823898 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:44.839571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:44.840650 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:44.840789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:44.841024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] PATH_INFO: `/v3/projects/d23994c826bf415b9e2e3b1690ddedec` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:44.843154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23994c826bf415b9e2e3b1690ddedec)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:44.845632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:44.903574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23994c826bf415b9e2e3b1690ddedec', 'request_id': 'req-e718c5a7-2714-4055-bfed-8a1ea5e10444'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.914749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23994c826bf415b9e2e3b1690ddedec', 'request_id': 'req-e718c5a7-2714-4055-bfed-8a1ea5e10444'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.921834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23994c826bf415b9e2e3b1690ddedec', 'request_id': 'req-e718c5a7-2714-4055-bfed-8a1ea5e10444'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.935176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] The token cache is being invalidate because project d23994c826bf415b9e2e3b1690ddedec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:44.935486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.936508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e718c5a7-2714-4055-bfed-8a1ea5e10444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:44.938591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 952/1894] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:44 2022] DELETE /identity/v3/projects/d23994c826bf415b9e2e3b1690ddedec => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:44.945292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658532c-d1b2-4e0d-b8e2-ebc6de5b9436 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:44.945592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658532c-d1b2-4e0d-b8e2-ebc6de5b9436 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:44.945871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658532c-d1b2-4e0d-b8e2-ebc6de5b9436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:44.966361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0658532c-d1b2-4e0d-b8e2-ebc6de5b9436 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:44.967604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0658532c-d1b2-4e0d-b8e2-ebc6de5b9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:45.039044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 943/1895] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:45.052456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21b64-33f7-462f-a7b0-58f3e5ca83b6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.052742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21b64-33f7-462f-a7b0-58f3e5ca83b6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.053047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21b64-33f7-462f-a7b0-58f3e5ca83b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.074131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-43a21b64-33f7-462f-a7b0-58f3e5ca83b6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:45.075398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-43a21b64-33f7-462f-a7b0-58f3e5ca83b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:45.085039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 953/1896] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:45.089956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658532c-d1b2-4e0d-b8e2-ebc6de5b9436 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:45.100564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658532c-d1b2-4e0d-b8e2-ebc6de5b9436 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:45.105780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:45.108290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.108290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.108290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.108290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:45.108290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:45.110041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:45.122558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 944/1897] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:45.126976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a21b64-33f7-462f-a7b0-58f3e5ca83b6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:45.136777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a21b64-33f7-462f-a7b0-58f3e5ca83b6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:45.141474 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1ccd-23a7-487b-858f-10d80ff93296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:45.142105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1ccd-23a7-487b-858f-10d80ff93296 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.142383 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1ccd-23a7-487b-858f-10d80ff93296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.142690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1ccd-23a7-487b-858f-10d80ff93296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.143394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1ccd-23a7-487b-858f-10d80ff93296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:45.145324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1ccd-23a7-487b-858f-10d80ff93296 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:45.182720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 954/1898] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:45 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:45.187081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:45.200839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d71895-5579-4fa3-acfc-0dfa7a949f42 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:45.244421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:45.291071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad5da1-ead4-43df-891a-a7bb7ed3de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:45.291688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad5da1-ead4-43df-891a-a7bb7ed3de14 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.291969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad5da1-ead4-43df-891a-a7bb7ed3de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.292242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad5da1-ead4-43df-891a-a7bb7ed3de14 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.292918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad5da1-ead4-43df-891a-a7bb7ed3de14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:45.294836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad5da1-ead4-43df-891a-a7bb7ed3de14 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:45.317683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 945/1899] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:45 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:45.321877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1ccd-23a7-487b-858f-10d80ff93296 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:45.333010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1ccd-23a7-487b-858f-10d80ff93296 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:45.337622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6aa4c-51dd-434b-877b-9c637c2fe8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:45.338238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6aa4c-51dd-434b-877b-9c637c2fe8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.338540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6aa4c-51dd-434b-877b-9c637c2fe8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.339405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6aa4c-51dd-434b-877b-9c637c2fe8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.340094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6aa4c-51dd-434b-877b-9c637c2fe8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:45.341939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6aa4c-51dd-434b-877b-9c637c2fe8fb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:45.352220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 955/1900] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:45.356261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad5da1-ead4-43df-891a-a7bb7ed3de14 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:45.367438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad5da1-ead4-43df-891a-a7bb7ed3de14 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:45.372056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ff6b9-c520-440c-9342-5394c3c1f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:45.372655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ff6b9-c520-440c-9342-5394c3c1f46a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.372947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ff6b9-c520-440c-9342-5394c3c1f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.373216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ff6b9-c520-440c-9342-5394c3c1f46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.373907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ff6b9-c520-440c-9342-5394c3c1f46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:45.375647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ff6b9-c520-440c-9342-5394c3c1f46a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:45.386315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 946/1901] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:45.390328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6aa4c-51dd-434b-877b-9c637c2fe8fb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:45.400140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6aa4c-51dd-434b-877b-9c637c2fe8fb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:45.405700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:45.406374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.406659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.406939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] PATH_INFO: `/v3/projects/9aad3ef85cb545fa9f8979add204bd74/users/3ef57d83d072437b8287d8d832f29493/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.421465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aad3ef85cb545fa9f8979add204bd74, user_id=3ef57d83d072437b8287d8d832f29493, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:45.424461 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:45.438377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 956/1902] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:45 2022] PUT /identity/v3/projects/9aad3ef85cb545fa9f8979add204bd74/users/3ef57d83d072437b8287d8d832f29493/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:45.450078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb034a-2626-4397-8740-18a41e767efd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.450440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb034a-2626-4397-8740-18a41e767efd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.450727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb034a-2626-4397-8740-18a41e767efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.481033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-85cb034a-2626-4397-8740-18a41e767efd None None] MFA Rules not processed for user `3ef57d83d072437b8287d8d832f29493`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:45.482253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-85cb034a-2626-4397-8740-18a41e767efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:45.561327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 947/1903] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:45.569519 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:45.571333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:45.632545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41698e3-406a-4571-adde-b365a07766c9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:45.636927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0bb79-83de-4713-8c1b-c11079e0a6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:45.637556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0bb79-83de-4713-8c1b-c11079e0a6af service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:45.637844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0bb79-83de-4713-8c1b-c11079e0a6af service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:45.638192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0bb79-83de-4713-8c1b-c11079e0a6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:45.648209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0bb79-83de-4713-8c1b-c11079e0a6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:45.649711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0bb79-83de-4713-8c1b-c11079e0a6af service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:45.664165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 957/1904] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:46.032663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb034a-2626-4397-8740-18a41e767efd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:46.034760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-85cb034a-2626-4397-8740-18a41e767efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:46.161720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb034a-2626-4397-8740-18a41e767efd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:46.167681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:46.168488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:46.169077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:46.169077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] PATH_INFO: `/v3/users/1514be6039114439ad057297371e8698` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:46.170442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1514be6039114439ad057297371e8698)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:46.172409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:46.226236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:46.228911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1514be6039114439ad057297371e8698'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:46.257390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1514be6039114439ad057297371e8698'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:46.257933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1514be6039114439ad057297371e8698'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:46.281213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1514be6039114439ad057297371e8698'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:46.283176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1514be6039114439ad057297371e8698'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:46.306953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 948/1905] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:46 2022] DELETE /identity/v3/users/1514be6039114439ad057297371e8698 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:46.312023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddcf30-b807-4982-bb63-82d8655c91cc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:46.313086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddcf30-b807-4982-bb63-82d8655c91cc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:46.313706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddcf30-b807-4982-bb63-82d8655c91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:46.334764 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b1ddcf30-b807-4982-bb63-82d8655c91cc None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:46.336550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b1ddcf30-b807-4982-bb63-82d8655c91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:46.358678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:46.436951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 958/1906] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:46.447624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:46.449136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:46.514394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edba7f-eb9f-444b-bc16-1ba6d850836b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:46.520063 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12999a7a-1d40-41d4-bdbe-29eaafc47733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:46.520711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12999a7a-1d40-41d4-bdbe-29eaafc47733 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:46.520997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12999a7a-1d40-41d4-bdbe-29eaafc47733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:46.521310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12999a7a-1d40-41d4-bdbe-29eaafc47733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:46.533009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12999a7a-1d40-41d4-bdbe-29eaafc47733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:46.534511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12999a7a-1d40-41d4-bdbe-29eaafc47733 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:46.545826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 949/1907] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:47.021613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddcf30-b807-4982-bb63-82d8655c91cc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:47.023259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b1ddcf30-b807-4982-bb63-82d8655c91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:47.038006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddcf30-b807-4982-bb63-82d8655c91cc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:47.045530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:47.046341 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.046626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.046904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] PATH_INFO: `/v3/projects/59d4107cbf18451da9a12ebcb8e658b7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.048422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d4107cbf18451da9a12ebcb8e658b7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:47.050723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:47.139833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d4107cbf18451da9a12ebcb8e658b7', 'request_id': 'req-a5715957-6125-4eb0-9830-af454e75940e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:47.150860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d4107cbf18451da9a12ebcb8e658b7', 'request_id': 'req-a5715957-6125-4eb0-9830-af454e75940e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:47.162168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d4107cbf18451da9a12ebcb8e658b7', 'request_id': 'req-a5715957-6125-4eb0-9830-af454e75940e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:47.178145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] The token cache is being invalidate because project 59d4107cbf18451da9a12ebcb8e658b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:47.178929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:47.179337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5715957-6125-4eb0-9830-af454e75940e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:47.181705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 959/1908] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:47 2022] DELETE /identity/v3/projects/59d4107cbf18451da9a12ebcb8e658b7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:47.195566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09e8c-c296-4220-8bd1-8713a86dcce2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.195566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09e8c-c296-4220-8bd1-8713a86dcce2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.195566 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09e8c-c296-4220-8bd1-8713a86dcce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.240622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-89f09e8c-c296-4220-8bd1-8713a86dcce2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:47.248703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-89f09e8c-c296-4220-8bd1-8713a86dcce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:47.342429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 950/1909] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:47.350594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c0d4-14f4-47e4-af3a-f05810f3bee4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.351462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c0d4-14f4-47e4-af3a-f05810f3bee4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.352295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c0d4-14f4-47e4-af3a-f05810f3bee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.377914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7289c0d4-14f4-47e4-af3a-f05810f3bee4 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:47.380510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7289c0d4-14f4-47e4-af3a-f05810f3bee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:47.394776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 960/1910] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:47.400440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09e8c-c296-4220-8bd1-8713a86dcce2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:47.428715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09e8c-c296-4220-8bd1-8713a86dcce2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:47.445347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:47.446001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.446424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.446936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.447823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:47.449620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:47.456820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:47.487972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 951/1911] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:47.494036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c0d4-14f4-47e4-af3a-f05810f3bee4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:47.505308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c0d4-14f4-47e4-af3a-f05810f3bee4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:47.511739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d2775-0296-488b-a876-f8aab2c76ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:47.512699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d2775-0296-488b-a876-f8aab2c76ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.513237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d2775-0296-488b-a876-f8aab2c76ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.513709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d2775-0296-488b-a876-f8aab2c76ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.514595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d2775-0296-488b-a876-f8aab2c76ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:47.517696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d2775-0296-488b-a876-f8aab2c76ea8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:47.572934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 961/1912] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:47 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:47.577447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:47.595781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04829-c73e-4f56-8567-a7f3ad711963 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:47.695573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:47.718942 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da363b76-8f57-4757-89cd-2d1f19091486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:47.719899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363b76-8f57-4757-89cd-2d1f19091486 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.720383 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363b76-8f57-4757-89cd-2d1f19091486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.721057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363b76-8f57-4757-89cd-2d1f19091486 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.721914 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da363b76-8f57-4757-89cd-2d1f19091486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:47.724933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da363b76-8f57-4757-89cd-2d1f19091486 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:47.760050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 952/1913] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:47 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:47.767484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d2775-0296-488b-a876-f8aab2c76ea8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:47.782688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d2775-0296-488b-a876-f8aab2c76ea8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:47.800218 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1574-aa34-47e4-ac2e-9c7f8c3740b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:47.800881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1574-aa34-47e4-ac2e-9c7f8c3740b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.801216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1574-aa34-47e4-ac2e-9c7f8c3740b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.801713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1574-aa34-47e4-ac2e-9c7f8c3740b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.802630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1574-aa34-47e4-ac2e-9c7f8c3740b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:47.804612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1574-aa34-47e4-ac2e-9c7f8c3740b8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:47.818943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 962/1914] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:38:47.822394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da363b76-8f57-4757-89cd-2d1f19091486 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:47.840541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da363b76-8f57-4757-89cd-2d1f19091486 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:47.853349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca909330-3596-448f-a224-915581979234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:47.855267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909330-3596-448f-a224-915581979234 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.855811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909330-3596-448f-a224-915581979234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.858162 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909330-3596-448f-a224-915581979234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.859153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca909330-3596-448f-a224-915581979234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:47.861097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca909330-3596-448f-a224-915581979234 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:47.880089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 953/1915] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:47.884185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1574-aa34-47e4-ac2e-9c7f8c3740b8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:47.895633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1574-aa34-47e4-ac2e-9c7f8c3740b8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:47.903902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfd0cd-67f2-4423-88fc-799f6eae821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:47.905143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd0cd-67f2-4423-88fc-799f6eae821e admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.905497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd0cd-67f2-4423-88fc-799f6eae821e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.905892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd0cd-67f2-4423-88fc-799f6eae821e admin admin] PATH_INFO: `/v3/projects/a49d0f8814254aee93c25d48087ceb8d/users/4b566a19f2ef41a8ba0c81cbca99be64/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.925708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfd0cd-67f2-4423-88fc-799f6eae821e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49d0f8814254aee93c25d48087ceb8d, user_id=4b566a19f2ef41a8ba0c81cbca99be64, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:47.929268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfd0cd-67f2-4423-88fc-799f6eae821e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:47.950932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 963/1916] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:47 2022] PUT /identity/v3/projects/a49d0f8814254aee93c25d48087ceb8d/users/4b566a19f2ef41a8ba0c81cbca99be64/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:47.974357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9a942-07f1-43fc-9f8e-98ade394d18c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.974663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9a942-07f1-43fc-9f8e-98ade394d18c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.974996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9a942-07f1-43fc-9f8e-98ade394d18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:48.016654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f1b9a942-07f1-43fc-9f8e-98ade394d18c None None] MFA Rules not processed for user `4b566a19f2ef41a8ba0c81cbca99be64`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:48.018199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f1b9a942-07f1-43fc-9f8e-98ade394d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:48.130989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 954/1917] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:48.135585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfd0cd-67f2-4423-88fc-799f6eae821e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:48.228463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:48.273610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfd0cd-67f2-4423-88fc-799f6eae821e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:48.280405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cced91-b45f-4cb3-87ee-e0348e92089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:48.281051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cced91-b45f-4cb3-87ee-e0348e92089c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:48.281337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cced91-b45f-4cb3-87ee-e0348e92089c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:48.281809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cced91-b45f-4cb3-87ee-e0348e92089c admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:48.282901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cced91-b45f-4cb3-87ee-e0348e92089c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:48.287013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cced91-b45f-4cb3-87ee-e0348e92089c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:48.332618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 964/1918] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:48 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:48.337120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9a942-07f1-43fc-9f8e-98ade394d18c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:48.354335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9a942-07f1-43fc-9f8e-98ade394d18c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:48.450974 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d254956-470f-43c4-992f-1b28b6b6cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:48.451871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254956-470f-43c4-992f-1b28b6b6cc46 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:48.452271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254956-470f-43c4-992f-1b28b6b6cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:48.452794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254956-470f-43c4-992f-1b28b6b6cc46 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:48.454193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d254956-470f-43c4-992f-1b28b6b6cc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:48.456987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d254956-470f-43c4-992f-1b28b6b6cc46 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:48.489546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cced91-b45f-4cb3-87ee-e0348e92089c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:48.491029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 955/1919] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:48 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:48.505699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cced91-b45f-4cb3-87ee-e0348e92089c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:48.511957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff9f0-4a9a-4575-9b5c-7c59764187ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:48.513349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff9f0-4a9a-4575-9b5c-7c59764187ea admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:48.513762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff9f0-4a9a-4575-9b5c-7c59764187ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:48.514187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff9f0-4a9a-4575-9b5c-7c59764187ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:48.515784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ff9f0-4a9a-4575-9b5c-7c59764187ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:48.517578 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ff9f0-4a9a-4575-9b5c-7c59764187ea admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:48.531176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 965/1920] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:48.534929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d254956-470f-43c4-992f-1b28b6b6cc46 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:48.551506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d254956-470f-43c4-992f-1b28b6b6cc46 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:48.557166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf1124-f3fa-4943-b1f9-f28195968e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:48.559331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf1124-f3fa-4943-b1f9-f28195968e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:48.560102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf1124-f3fa-4943-b1f9-f28195968e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:48.560577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf1124-f3fa-4943-b1f9-f28195968e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:48.561717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf1124-f3fa-4943-b1f9-f28195968e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:48.564085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf1124-f3fa-4943-b1f9-f28195968e20 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:48.577772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 956/1921] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:48.582924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff9f0-4a9a-4575-9b5c-7c59764187ea admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:48.594647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff9f0-4a9a-4575-9b5c-7c59764187ea admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:48.608776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3183e3-57b5-4c84-a0ee-a3a3a4a4b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:48.609958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3183e3-57b5-4c84-a0ee-a3a3a4a4b512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:48.610509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3183e3-57b5-4c84-a0ee-a3a3a4a4b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:48.611079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3183e3-57b5-4c84-a0ee-a3a3a4a4b512 admin admin] PATH_INFO: `/v3/projects/e8d6723706984b27a1dbd217d5200fe4/users/400f971db5b6451d808c18e8bbcc1e24/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:48.632255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3183e3-57b5-4c84-a0ee-a3a3a4a4b512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d6723706984b27a1dbd217d5200fe4, user_id=400f971db5b6451d808c18e8bbcc1e24, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:48.635586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3183e3-57b5-4c84-a0ee-a3a3a4a4b512 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:48.664192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 966/1922] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:48 2022] PUT /identity/v3/projects/e8d6723706984b27a1dbd217d5200fe4/users/400f971db5b6451d808c18e8bbcc1e24/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:48.678466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c02ef-f2b5-4b08-8f9d-def1967c21d4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:48.678972 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c02ef-f2b5-4b08-8f9d-def1967c21d4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:48.679303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c02ef-f2b5-4b08-8f9d-def1967c21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:48.723129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ae4c02ef-f2b5-4b08-8f9d-def1967c21d4 None None] MFA Rules not processed for user `400f971db5b6451d808c18e8bbcc1e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:48.724822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ae4c02ef-f2b5-4b08-8f9d-def1967c21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:48.795856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:48.848410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 957/1923] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:48.853321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3183e3-57b5-4c84-a0ee-a3a3a4a4b512 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:48.935982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3183e3-57b5-4c84-a0ee-a3a3a4a4b512 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:48.941743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bbcfa-38b1-4772-b018-2f3bc7bb9ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:48.942666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bbcfa-38b1-4772-b018-2f3bc7bb9ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:48.943007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bbcfa-38b1-4772-b018-2f3bc7bb9ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:48.943277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bbcfa-38b1-4772-b018-2f3bc7bb9ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:48.944005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bbcfa-38b1-4772-b018-2f3bc7bb9ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:48.945960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bbcfa-38b1-4772-b018-2f3bc7bb9ebb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:48.982703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 967/1924] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:48 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:48.988541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c02ef-f2b5-4b08-8f9d-def1967c21d4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:49.008043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c02ef-f2b5-4b08-8f9d-def1967c21d4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:49.108939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad032ec3-79ec-4b82-b0af-4e22bd93a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:49.109647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad032ec3-79ec-4b82-b0af-4e22bd93a54b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.109943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad032ec3-79ec-4b82-b0af-4e22bd93a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.110235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad032ec3-79ec-4b82-b0af-4e22bd93a54b admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.110983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad032ec3-79ec-4b82-b0af-4e22bd93a54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:49.113032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad032ec3-79ec-4b82-b0af-4e22bd93a54b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:49.149255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 958/1925] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:48 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:49.153769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bbcfa-38b1-4772-b018-2f3bc7bb9ebb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:49.165828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bbcfa-38b1-4772-b018-2f3bc7bb9ebb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:49.171769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbcae3-049c-493e-99d0-51ee1206223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:49.172654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbcae3-049c-493e-99d0-51ee1206223d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.172939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbcae3-049c-493e-99d0-51ee1206223d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.173210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbcae3-049c-493e-99d0-51ee1206223d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.173918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbcae3-049c-493e-99d0-51ee1206223d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:49.175853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbcae3-049c-493e-99d0-51ee1206223d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:49.192678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 968/1926] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:49.194398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad032ec3-79ec-4b82-b0af-4e22bd93a54b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:49.207729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad032ec3-79ec-4b82-b0af-4e22bd93a54b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:49.215235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f1c78-e83c-4db1-938b-1bd1d46b8653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:49.216181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1c78-e83c-4db1-938b-1bd1d46b8653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.218944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1c78-e83c-4db1-938b-1bd1d46b8653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.219335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1c78-e83c-4db1-938b-1bd1d46b8653 admin admin] PATH_INFO: `/v3/projects/c8b0a28e82694b8cac7bfc07f439e9f2/users/b7dafeea867248eca8940bd470e6854f/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.255775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f1c78-e83c-4db1-938b-1bd1d46b8653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b0a28e82694b8cac7bfc07f439e9f2, user_id=b7dafeea867248eca8940bd470e6854f, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:49.257748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f1c78-e83c-4db1-938b-1bd1d46b8653 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:49.291892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 959/1927] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:49 2022] PUT /identity/v3/projects/c8b0a28e82694b8cac7bfc07f439e9f2/users/b7dafeea867248eca8940bd470e6854f/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:49.296515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbcae3-049c-493e-99d0-51ee1206223d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:49.319065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbcae3-049c-493e-99d0-51ee1206223d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:49.396908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9816503-9bd3-483f-b40e-9d7c8d55e9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:49.397555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816503-9bd3-483f-b40e-9d7c8d55e9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.397827 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816503-9bd3-483f-b40e-9d7c8d55e9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.398125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816503-9bd3-483f-b40e-9d7c8d55e9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.398931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9816503-9bd3-483f-b40e-9d7c8d55e9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:49.400623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9816503-9bd3-483f-b40e-9d7c8d55e9aa admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:49.426348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 969/1928] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:49.429044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f1c78-e83c-4db1-938b-1bd1d46b8653 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:49.446879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f1c78-e83c-4db1-938b-1bd1d46b8653 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:49.454965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:49.456192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.456689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.457224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] PATH_INFO: `/v3/projects/c8b0a28e82694b8cac7bfc07f439e9f2/users/b7dafeea867248eca8940bd470e6854f/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.460286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b0a28e82694b8cac7bfc07f439e9f2, user_id=b7dafeea867248eca8940bd470e6854f, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:49.463964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:49.487443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 960/1929] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:49 2022] PUT /identity/v3/projects/c8b0a28e82694b8cac7bfc07f439e9f2/users/b7dafeea867248eca8940bd470e6854f/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:49.499213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c6959-4398-405d-a0a5-c4528d42b1d8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.499746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c6959-4398-405d-a0a5-c4528d42b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.500015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c6959-4398-405d-a0a5-c4528d42b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.506828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:49.509386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:49.511336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:49.544443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cf3c6959-4398-405d-a0a5-c4528d42b1d8 None None] MFA Rules not processed for user `b7dafeea867248eca8940bd470e6854f`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:49.545798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cf3c6959-4398-405d-a0a5-c4528d42b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:49.599763 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd817f-643d-4699-b67b-4ece0e4e5df9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:49.605959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:49.606850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.607204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.607578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] PATH_INFO: `/v3/users/3ef57d83d072437b8287d8d832f29493` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.608869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef57d83d072437b8287d8d832f29493)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:49.611646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:49.646663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:49.677840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 970/1930] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:49.689560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c6959-4398-405d-a0a5-c4528d42b1d8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:49.692293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cf3c6959-4398-405d-a0a5-c4528d42b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:49.692643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef57d83d072437b8287d8d832f29493'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:49.702415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef57d83d072437b8287d8d832f29493'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:49.703443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef57d83d072437b8287d8d832f29493'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:49.719675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef57d83d072437b8287d8d832f29493'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:49.720575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e27a40bd-31de-4007-a9a9-263adcac7d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef57d83d072437b8287d8d832f29493'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:49.737630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 961/1931] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:49 2022] DELETE /identity/v3/users/3ef57d83d072437b8287d8d832f29493 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:49.743165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acaf4-93d8-448d-a67f-4967793b55c1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.743511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acaf4-93d8-448d-a67f-4967793b55c1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.744087 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acaf4-93d8-448d-a67f-4967793b55c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.767650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-092acaf4-93d8-448d-a67f-4967793b55c1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:49.768865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-092acaf4-93d8-448d-a67f-4967793b55c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:49.819041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c6959-4398-405d-a0a5-c4528d42b1d8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:49.915080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 962/1932] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:49.922345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092acaf4-93d8-448d-a67f-4967793b55c1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:49.926373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-092acaf4-93d8-448d-a67f-4967793b55c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:49.941882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:49.942616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:49.943314 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:49.946700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:49.949570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:50.041519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092acaf4-93d8-448d-a67f-4967793b55c1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:50.044084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:50.045551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:50.046161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:50.046271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:50.046457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:50.046737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:50.051901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:50.059484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:50.061143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:50.062400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 971/1933] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:38:50.076188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 963/1934] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:50.446127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:50.449017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:50.484095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9cd7e-9d43-409f-b7d1-64fc9cd61723 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:50.505512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:50.507184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:50.507652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:50.507982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] PATH_INFO: `/v3/projects/9aad3ef85cb545fa9f8979add204bd74` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:50.509570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aad3ef85cb545fa9f8979add204bd74)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:50.511681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:50.605659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aad3ef85cb545fa9f8979add204bd74', 'request_id': 'req-33beccd5-e11f-420d-a404-01ca45c7beb7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:50.620906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aad3ef85cb545fa9f8979add204bd74', 'request_id': 'req-33beccd5-e11f-420d-a404-01ca45c7beb7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:50.631036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aad3ef85cb545fa9f8979add204bd74', 'request_id': 'req-33beccd5-e11f-420d-a404-01ca45c7beb7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:50.664568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] The token cache is being invalidate because project 9aad3ef85cb545fa9f8979add204bd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:50.664822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:50.669853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33beccd5-e11f-420d-a404-01ca45c7beb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:50.696326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 972/1935] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:50 2022] DELETE /identity/v3/projects/9aad3ef85cb545fa9f8979add204bd74 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:51.221819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:51.223363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:51.247734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd7f0a-944c-4ef4-b22c-b11caa0eaa76 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:51.314058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:51.336912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:51.338089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:51.338639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:51.339630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] PATH_INFO: `/v3/users/6375d403e9b742a7a7e3aebf413b2dcf` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:51.341321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6375d403e9b742a7a7e3aebf413b2dcf)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:51.344035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:51.413363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6375d403e9b742a7a7e3aebf413b2dcf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:51.429618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6375d403e9b742a7a7e3aebf413b2dcf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:51.430563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6375d403e9b742a7a7e3aebf413b2dcf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:51.447131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6375d403e9b742a7a7e3aebf413b2dcf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:51.448438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6375d403e9b742a7a7e3aebf413b2dcf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:51.464942 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 964/1936] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:51 2022] DELETE /identity/v3/users/6375d403e9b742a7a7e3aebf413b2dcf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:51.470139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b464c-67f7-4cab-ac8e-13c4fa80db96 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:51.470550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b464c-67f7-4cab-ac8e-13c4fa80db96 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:51.470904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b464c-67f7-4cab-ac8e-13c4fa80db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:51.496202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2d0b464c-67f7-4cab-ac8e-13c4fa80db96 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:51.497567 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2d0b464c-67f7-4cab-ac8e-13c4fa80db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:51.576384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 973/1937] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:38:51.587509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:51.589220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:51.667554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fa85a-454a-4270-b62a-1ad7242388bd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:51.672183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:51.672923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:51.673262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:51.673593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:51.685085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:51.686567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:51.697904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 965/1938] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:51.988215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b464c-67f7-4cab-ac8e-13c4fa80db96 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:51.989756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2d0b464c-67f7-4cab-ac8e-13c4fa80db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:52.029645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:52.031139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:52.045746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358c00-b95d-4034-8802-5976bea2a499 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:52.053079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:52.054296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:52.055009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:52.055502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] PATH_INFO: `/v3/projects/862a989ab1854c3c93b5411595d304e9` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:52.060094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=862a989ab1854c3c93b5411595d304e9)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:52.063009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:52.070881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b464c-67f7-4cab-ac8e-13c4fa80db96 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:52.074889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:52.076302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:52.076476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:52.077823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:52.089929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:52.123305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862a989ab1854c3c93b5411595d304e9', 'request_id': 'req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.131114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862a989ab1854c3c93b5411595d304e9', 'request_id': 'req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.131330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:52.136457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:52.142526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862a989ab1854c3c93b5411595d304e9', 'request_id': 'req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.162305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] The token cache is being invalidate because project 862a989ab1854c3c93b5411595d304e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:52.162628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.164554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.167809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 966/1939] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:52 2022] DELETE /identity/v3/projects/862a989ab1854c3c93b5411595d304e9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:52.172057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:52.173814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:52.177276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:52.179471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:52.204553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 974/1940] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:52.296704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc12cc-fc69-4bbf-8688-568f4cb0f453 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:52.308665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:52.309882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:52.315017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:52.315307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] PATH_INFO: `/v3/users/af4cdb9cd2a644088ad47736b6588c74` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:52.317106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4cdb9cd2a644088ad47736b6588c74)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:52.319328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:52.458863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4cdb9cd2a644088ad47736b6588c74'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.480504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4cdb9cd2a644088ad47736b6588c74'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.482781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4cdb9cd2a644088ad47736b6588c74'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.520712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4cdb9cd2a644088ad47736b6588c74'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.522168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4cdb9cd2a644088ad47736b6588c74'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:52.554424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 967/1941] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:52 2022] DELETE /identity/v3/users/af4cdb9cd2a644088ad47736b6588c74 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:53.146360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:53.172096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b583a19-2429-4656-a9b2-25d85fd94254 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:53.325403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:53.326412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.326559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.326846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] PATH_INFO: `/v3/projects/e90d4c6b1e444ea2936db1f5bd67bbd4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.328200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90d4c6b1e444ea2936db1f5bd67bbd4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:53.330235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:53.396325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90d4c6b1e444ea2936db1f5bd67bbd4', 'request_id': 'req-36039431-469f-4dd9-a58a-b7ba6ae633ea'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:53.409264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90d4c6b1e444ea2936db1f5bd67bbd4', 'request_id': 'req-36039431-469f-4dd9-a58a-b7ba6ae633ea'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:53.420498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90d4c6b1e444ea2936db1f5bd67bbd4', 'request_id': 'req-36039431-469f-4dd9-a58a-b7ba6ae633ea'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:53.425491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:53.427015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:53.434590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] The token cache is being invalidate because project e90d4c6b1e444ea2936db1f5bd67bbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:53.434981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:53.435698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36039431-469f-4dd9-a58a-b7ba6ae633ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:53.438333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 975/1942] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:53 2022] DELETE /identity/v3/projects/e90d4c6b1e444ea2936db1f5bd67bbd4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:53.443108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b36d-3b24-4bc7-96ca-f60c30ed5401 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.443510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b36d-3b24-4bc7-96ca-f60c30ed5401 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.443859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b36d-3b24-4bc7-96ca-f60c30ed5401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.466811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ba49b36d-3b24-4bc7-96ca-f60c30ed5401 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:53.468102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ba49b36d-3b24-4bc7-96ca-f60c30ed5401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:53.504152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f659-17f0-47ad-bc55-0fd6a6e248df admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:53.525418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:53.545646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 976/1943] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:38:53.554476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41a13-8137-4dc5-99e1-3e5d40f66571 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.554685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41a13-8137-4dc5-99e1-3e5d40f66571 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.554972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41a13-8137-4dc5-99e1-3e5d40f66571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.572806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:53.573521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:53.573758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.574443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.574443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.576423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:53.581238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c9c41a13-8137-4dc5-99e1-3e5d40f66571 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:53.586486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c9c41a13-8137-4dc5-99e1-3e5d40f66571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:53.598017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 977/1944] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:53.602202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c41a13-8137-4dc5-99e1-3e5d40f66571 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:53.618144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c41a13-8137-4dc5-99e1-3e5d40f66571 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:53.626105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:53.626941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.627340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.627758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.629455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:53.629867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:53.631673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:53.648605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 978/1945] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:38:53.653088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:53.663234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c879-ef45-4a04-b686-d3aa2e8dc313 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:53.668818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1619bf-e3aa-4316-a732-e44860926a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:53.669460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1619bf-e3aa-4316-a732-e44860926a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.669808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1619bf-e3aa-4316-a732-e44860926a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.670094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1619bf-e3aa-4316-a732-e44860926a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.670775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1619bf-e3aa-4316-a732-e44860926a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:53.673045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1619bf-e3aa-4316-a732-e44860926a26 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:53.684781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:53.686279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:53.697565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 968/1946] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:38:53.705543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 979/1947] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:53 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:38:53.709704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:53.722046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fda71-1154-49e5-9064-79bbd997f129 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:53.804314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbdbd-5d4f-470c-88d7-89f3905ee1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:53.805441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbdbd-5d4f-470c-88d7-89f3905ee1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.805782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbdbd-5d4f-470c-88d7-89f3905ee1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.806152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbdbd-5d4f-470c-88d7-89f3905ee1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.807147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bbdbd-5d4f-470c-88d7-89f3905ee1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:53.810339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bbdbd-5d4f-470c-88d7-89f3905ee1a6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:53.840666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 969/1948] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:53 2022] POST /identity/v3/users => generated 282 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:53.845588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1619bf-e3aa-4316-a732-e44860926a26 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:53.858428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1619bf-e3aa-4316-a732-e44860926a26 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:53.863498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c819be-3490-4989-9733-49762140bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:53.864158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c819be-3490-4989-9733-49762140bb37 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.864442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c819be-3490-4989-9733-49762140bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.864715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c819be-3490-4989-9733-49762140bb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.865446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c819be-3490-4989-9733-49762140bb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:53.867191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c819be-3490-4989-9733-49762140bb37 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:53.878495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 980/1949] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:53.882752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbdbd-5d4f-470c-88d7-89f3905ee1a6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:53.893377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbdbd-5d4f-470c-88d7-89f3905ee1a6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:53.898563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cff6e4-a5c3-4d81-9e6f-a87ee722ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:53.899213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff6e4-a5c3-4d81-9e6f-a87ee722ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.899526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff6e4-a5c3-4d81-9e6f-a87ee722ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.899808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff6e4-a5c3-4d81-9e6f-a87ee722ee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.900519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cff6e4-a5c3-4d81-9e6f-a87ee722ee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:53.903190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cff6e4-a5c3-4d81-9e6f-a87ee722ee6b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:53.917976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 970/1950] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:53.919644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c819be-3490-4989-9733-49762140bb37 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:53.930434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c819be-3490-4989-9733-49762140bb37 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:53.935409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3fef-02a8-450a-8ccb-bcd3034f2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:53.936126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3fef-02a8-450a-8ccb-bcd3034f2734 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:53.936411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3fef-02a8-450a-8ccb-bcd3034f2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:53.936691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3fef-02a8-450a-8ccb-bcd3034f2734 admin admin] PATH_INFO: `/v3/projects/4b2ecf74b87f4016b11d8edef33359a0/users/0ed2a784b59c4b4a8723de6e413730e6/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:53.954760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d3fef-02a8-450a-8ccb-bcd3034f2734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2ecf74b87f4016b11d8edef33359a0, user_id=0ed2a784b59c4b4a8723de6e413730e6, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:53.957626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d3fef-02a8-450a-8ccb-bcd3034f2734 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:53.973708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 981/1951] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:53 2022] PUT /identity/v3/projects/4b2ecf74b87f4016b11d8edef33359a0/users/0ed2a784b59c4b4a8723de6e413730e6/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:54.001336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206d25-ab66-4480-bd52-6d3fa769be45 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.001621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206d25-ab66-4480-bd52-6d3fa769be45 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.002862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206d25-ab66-4480-bd52-6d3fa769be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.034800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ad206d25-ab66-4480-bd52-6d3fa769be45 None None] MFA Rules not processed for user `0ed2a784b59c4b4a8723de6e413730e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:54.036157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ad206d25-ab66-4480-bd52-6d3fa769be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:54.092397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:54.122330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 971/1952] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:54.129653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3fef-02a8-450a-8ccb-bcd3034f2734 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:54.209239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3fef-02a8-450a-8ccb-bcd3034f2734 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:54.223971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc838e5-dd53-4877-a2c0-c65c1c568f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:54.224622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc838e5-dd53-4877-a2c0-c65c1c568f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.224899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc838e5-dd53-4877-a2c0-c65c1c568f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.225174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc838e5-dd53-4877-a2c0-c65c1c568f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.225929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc838e5-dd53-4877-a2c0-c65c1c568f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:54.228011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc838e5-dd53-4877-a2c0-c65c1c568f65 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:54.264587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 982/1953] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:38:54 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:54.268583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad206d25-ab66-4480-bd52-6d3fa769be45 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:54.283726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad206d25-ab66-4480-bd52-6d3fa769be45 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:54.345700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3ae6-a880-48f4-8126-e3285528b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:54.346556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3ae6-a880-48f4-8126-e3285528b72e admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.346924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3ae6-a880-48f4-8126-e3285528b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.347202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3ae6-a880-48f4-8126-e3285528b72e admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.347915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a3ae6-a880-48f4-8126-e3285528b72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:54.349929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a3ae6-a880-48f4-8126-e3285528b72e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:54.376879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 972/1954] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:38:54 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:54.377819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc838e5-dd53-4877-a2c0-c65c1c568f65 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:54.388189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc838e5-dd53-4877-a2c0-c65c1c568f65 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:54.393022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac05b6-6086-4806-873b-9f80058a8c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:54.393716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac05b6-6086-4806-873b-9f80058a8c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.394067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac05b6-6086-4806-873b-9f80058a8c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.394405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac05b6-6086-4806-873b-9f80058a8c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.395166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac05b6-6086-4806-873b-9f80058a8c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:54.396901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac05b6-6086-4806-873b-9f80058a8c8f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:54.408140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 983/1955] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:54.412932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3ae6-a880-48f4-8126-e3285528b72e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:54.423928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3ae6-a880-48f4-8126-e3285528b72e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:54.429041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293eac-63e3-4d35-ada3-5ba749aa17d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:54.429779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293eac-63e3-4d35-ada3-5ba749aa17d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.430095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293eac-63e3-4d35-ada3-5ba749aa17d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.430375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293eac-63e3-4d35-ada3-5ba749aa17d0 admin admin] PATH_INFO: `/v3/projects/62894e9d07fa4c6fb2b99bb868612111/users/c6a31c59d1b44055b64dc6a7fe544058/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.447123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76293eac-63e3-4d35-ada3-5ba749aa17d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62894e9d07fa4c6fb2b99bb868612111, user_id=c6a31c59d1b44055b64dc6a7fe544058, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:54.449895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76293eac-63e3-4d35-ada3-5ba749aa17d0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:54.464417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 973/1956] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:54 2022] PUT /identity/v3/projects/62894e9d07fa4c6fb2b99bb868612111/users/c6a31c59d1b44055b64dc6a7fe544058/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:54.469608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac05b6-6086-4806-873b-9f80058a8c8f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:54.480591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac05b6-6086-4806-873b-9f80058a8c8f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:54.545537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e265-6974-413f-959c-408e1dcb83b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:54.546298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e265-6974-413f-959c-408e1dcb83b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.546494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e265-6974-413f-959c-408e1dcb83b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.546776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e265-6974-413f-959c-408e1dcb83b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.547685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5e265-6974-413f-959c-408e1dcb83b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:54.549599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5e265-6974-413f-959c-408e1dcb83b3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:54.555899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:54.566747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 984/1957] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:54.567959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293eac-63e3-4d35-ada3-5ba749aa17d0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:54.578728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293eac-63e3-4d35-ada3-5ba749aa17d0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:54.583503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:54.584215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.584481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.584756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] PATH_INFO: `/v3/projects/62894e9d07fa4c6fb2b99bb868612111/users/c6a31c59d1b44055b64dc6a7fe544058/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.586765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62894e9d07fa4c6fb2b99bb868612111, user_id=c6a31c59d1b44055b64dc6a7fe544058, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:54.590047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:54.601857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 974/1958] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:38:54 2022] PUT /identity/v3/projects/62894e9d07fa4c6fb2b99bb868612111/users/c6a31c59d1b44055b64dc6a7fe544058/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:54.613739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4caf6a-bd02-420e-a3da-3943057920d6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.614030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4caf6a-bd02-420e-a3da-3943057920d6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.614317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4caf6a-bd02-420e-a3da-3943057920d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.648210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1c4caf6a-bd02-420e-a3da-3943057920d6 None None] MFA Rules not processed for user `c6a31c59d1b44055b64dc6a7fe544058`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:54.649773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c4caf6a-bd02-420e-a3da-3943057920d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:54.755944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 985/1959] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:54.768414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:54.770584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:54.837438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720bcd-2267-483c-8839-180e4dd2f19c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:54.842579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:54.843193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.843503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.843781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:54.855598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:54.857008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:54.872581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 975/1960] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:54.957064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4caf6a-bd02-420e-a3da-3943057920d6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:54.968089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4caf6a-bd02-420e-a3da-3943057920d6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:54.972936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17bc8-9a38-4801-b763-d389df1280f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:54.973682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17bc8-9a38-4801-b763-d389df1280f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:54.973966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17bc8-9a38-4801-b763-d389df1280f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:54.974299 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17bc8-9a38-4801-b763-d389df1280f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:55.058492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee17bc8-9a38-4801-b763-d389df1280f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:55.060589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee17bc8-9a38-4801-b763-d389df1280f2 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:55.072586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 986/1961] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:57.969113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:57.971175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:58.016901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:58.045251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd1c8-f476-4a8f-a740-2b58b5f58352 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:58.051044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:58.051743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:58.052164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:58.052323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] PATH_INFO: `/v3/users/4b566a19f2ef41a8ba0c81cbca99be64` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:58.053499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b566a19f2ef41a8ba0c81cbca99be64)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:58.055467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:58.112090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b566a19f2ef41a8ba0c81cbca99be64'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.120447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b566a19f2ef41a8ba0c81cbca99be64'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.121662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b566a19f2ef41a8ba0c81cbca99be64'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.135510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b566a19f2ef41a8ba0c81cbca99be64'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.136355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b566a19f2ef41a8ba0c81cbca99be64'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.150654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 976/1962] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:57 2022] DELETE /identity/v3/users/4b566a19f2ef41a8ba0c81cbca99be64 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:58.155676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095c2d4-dd92-4acb-811b-8ab30cea3423 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:58.156632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095c2d4-dd92-4acb-811b-8ab30cea3423 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:58.157141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095c2d4-dd92-4acb-811b-8ab30cea3423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:58.181598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2095c2d4-dd92-4acb-811b-8ab30cea3423 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:58.183286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2095c2d4-dd92-4acb-811b-8ab30cea3423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:58.193921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:58.196296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:58.282390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb3430-dab9-4813-a40d-b5050610fcb2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:58.287009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:58.287740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:58.288018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:58.288751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] PATH_INFO: `/v3/users/0ed2a784b59c4b4a8723de6e413730e6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:58.289722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed2a784b59c4b4a8723de6e413730e6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:58.292241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:58.295363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 987/1963] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:58.296807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095c2d4-dd92-4acb-811b-8ab30cea3423 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:58.298390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2095c2d4-dd92-4acb-811b-8ab30cea3423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:58.331363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:58.348280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed2a784b59c4b4a8723de6e413730e6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.358602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed2a784b59c4b4a8723de6e413730e6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.359358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed2a784b59c4b4a8723de6e413730e6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.362371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:58.366347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095c2d4-dd92-4acb-811b-8ab30cea3423 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:58.370943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:58.371946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:58.372421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:58.373181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:58.375952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed2a784b59c4b4a8723de6e413730e6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.377036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-326f9f63-bab5-46d5-8c37-0a53353ea876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed2a784b59c4b4a8723de6e413730e6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.388927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:58.390586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:58.397716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 977/1964] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:58 2022] DELETE /identity/v3/users/0ed2a784b59c4b4a8723de6e413730e6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:58.399497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1c546-af7c-4ebc-96a7-267dcea7fb89 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:58.399974 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1c546-af7c-4ebc-96a7-267dcea7fb89 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:58.400436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1c546-af7c-4ebc-96a7-267dcea7fb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:58.403709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 988/1965] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:58.424944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1ae1c546-af7c-4ebc-96a7-267dcea7fb89 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:58.426191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1ae1c546-af7c-4ebc-96a7-267dcea7fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:58.520796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 978/1966] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:58.528950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:58.530390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:58.545819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8dfa5-8b00-4787-970a-c859a889d1af service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:58.645588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef051-6cd3-43f1-8982-cdc9c9aa29f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:58.646778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef051-6cd3-43f1-8982-cdc9c9aa29f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:58.647075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef051-6cd3-43f1-8982-cdc9c9aa29f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:58.647359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef051-6cd3-43f1-8982-cdc9c9aa29f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:58.662727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef051-6cd3-43f1-8982-cdc9c9aa29f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:58.664215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef051-6cd3-43f1-8982-cdc9c9aa29f8 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:58.678582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 989/1967] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:58.798281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1c546-af7c-4ebc-96a7-267dcea7fb89 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:58.800091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1ae1c546-af7c-4ebc-96a7-267dcea7fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:58.817729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1c546-af7c-4ebc-96a7-267dcea7fb89 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:58.825756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:58.826738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:58.826967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:58.827243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] PATH_INFO: `/v3/projects/a49d0f8814254aee93c25d48087ceb8d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:58.828749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49d0f8814254aee93c25d48087ceb8d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:58.831619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:58.905843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49d0f8814254aee93c25d48087ceb8d', 'request_id': 'req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.913488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49d0f8814254aee93c25d48087ceb8d', 'request_id': 'req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.921339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49d0f8814254aee93c25d48087ceb8d', 'request_id': 'req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.938852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] The token cache is being invalidate because project a49d0f8814254aee93c25d48087ceb8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:58.939145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.939827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:58.941929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 979/1968] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:58 2022] DELETE /identity/v3/projects/a49d0f8814254aee93c25d48087ceb8d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:58.946094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef051-6cd3-43f1-8982-cdc9c9aa29f8 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:58.956828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef051-6cd3-43f1-8982-cdc9c9aa29f8 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:59.022055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:59.022752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:59.022962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:59.023239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] PATH_INFO: `/v3/users/400f971db5b6451d808c18e8bbcc1e24` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:59.024510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] RBAC: Authorizing `identity:delete_user(user_id=400f971db5b6451d808c18e8bbcc1e24)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:59.027330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:59.088142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400f971db5b6451d808c18e8bbcc1e24'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.099599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400f971db5b6451d808c18e8bbcc1e24'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.111544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400f971db5b6451d808c18e8bbcc1e24'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.113644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400f971db5b6451d808c18e8bbcc1e24'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.126832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:59.135044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400f971db5b6451d808c18e8bbcc1e24'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.146431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 990/1969] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:58 2022] DELETE /identity/v3/users/400f971db5b6451d808c18e8bbcc1e24 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:59.201889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:59.203903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:59.225123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb5af-56f3-4f8b-9f01-7e3d65ce645c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:59.301093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:59.308798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:59.309663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:59.309982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:59.310638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] PATH_INFO: `/v3/projects/4b2ecf74b87f4016b11d8edef33359a0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:59.314200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2ecf74b87f4016b11d8edef33359a0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:59.319985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:59.390524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2ecf74b87f4016b11d8edef33359a0', 'request_id': 'req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.400057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2ecf74b87f4016b11d8edef33359a0', 'request_id': 'req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.430833 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2ecf74b87f4016b11d8edef33359a0', 'request_id': 'req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.474837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] The token cache is being invalidate because project 4b2ecf74b87f4016b11d8edef33359a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:59.475141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.476207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.480616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 980/1970] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:59 2022] DELETE /identity/v3/projects/4b2ecf74b87f4016b11d8edef33359a0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:59.484379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:59.485980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:59.502892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d5ca5-4ba2-4c96-b5cc-6776788b345d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:59.646363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:59.648004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:59.669135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:59.670646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:59.670646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:59.670646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] PATH_INFO: `/v3/users/c6a31c59d1b44055b64dc6a7fe544058` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:59.672426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a31c59d1b44055b64dc6a7fe544058)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:59.675594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:59.781631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04d6f9-f233-4a5d-b02c-b77a2cd31568 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:59.787308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:59.788630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:59.788630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:59.788973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] PATH_INFO: `/v3/projects/e8d6723706984b27a1dbd217d5200fe4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:59.790236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d6723706984b27a1dbd217d5200fe4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:59.793133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:59.797630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a31c59d1b44055b64dc6a7fe544058'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.815213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a31c59d1b44055b64dc6a7fe544058'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.825246 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a31c59d1b44055b64dc6a7fe544058'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.826083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a31c59d1b44055b64dc6a7fe544058'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.846927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a31c59d1b44055b64dc6a7fe544058'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.856600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 991/1971] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:59 2022] DELETE /identity/v3/users/c6a31c59d1b44055b64dc6a7fe544058 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:59.886354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d6723706984b27a1dbd217d5200fe4', 'request_id': 'req-42ac3a64-f470-481f-9b21-eedc4c6c8d74'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.893865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d6723706984b27a1dbd217d5200fe4', 'request_id': 'req-42ac3a64-f470-481f-9b21-eedc4c6c8d74'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.904940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d6723706984b27a1dbd217d5200fe4', 'request_id': 'req-42ac3a64-f470-481f-9b21-eedc4c6c8d74'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.927088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] The token cache is being invalidate because project e8d6723706984b27a1dbd217d5200fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:38:59.927435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.928803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:38:59.930741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 981/1972] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:38:59 2022] DELETE /identity/v3/projects/e8d6723706984b27a1dbd217d5200fe4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:38:59.936660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:59.938939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:00.060793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64dca8-e912-4b30-8639-2532c083f8c6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:00.068040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:00.069421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:00.069905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:00.070244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] PATH_INFO: `/v3/users/b7dafeea867248eca8940bd470e6854f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:00.071683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7dafeea867248eca8940bd470e6854f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:00.074345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:00.124126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:00.194856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7dafeea867248eca8940bd470e6854f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.212995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7dafeea867248eca8940bd470e6854f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.228582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7dafeea867248eca8940bd470e6854f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.229712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7dafeea867248eca8940bd470e6854f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.255411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7dafeea867248eca8940bd470e6854f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.272536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 992/1973] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:38:59 2022] DELETE /identity/v3/users/b7dafeea867248eca8940bd470e6854f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:00.344848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:00.346464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:00.421755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:00.525726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac3a64-f470-481f-9b21-eedc4c6c8d74 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:00.646866 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:00.648202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:00.648739 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:00.649146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] PATH_INFO: `/v3/projects/62894e9d07fa4c6fb2b99bb868612111` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:00.651132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62894e9d07fa4c6fb2b99bb868612111)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:00.653043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:00.720112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62894e9d07fa4c6fb2b99bb868612111', 'request_id': 'req-ace83da2-7801-418c-9e18-ea5a15bdbd1c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.728041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62894e9d07fa4c6fb2b99bb868612111', 'request_id': 'req-ace83da2-7801-418c-9e18-ea5a15bdbd1c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.735734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62894e9d07fa4c6fb2b99bb868612111', 'request_id': 'req-ace83da2-7801-418c-9e18-ea5a15bdbd1c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.739308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:00.741146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:00.760036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273213c-3e27-4b03-9be2-90350d61f833 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:00.773000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] The token cache is being invalidate because project 62894e9d07fa4c6fb2b99bb868612111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:00.777699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.779673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ace83da2-7801-418c-9e18-ea5a15bdbd1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.789068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 982/1974] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:00 2022] DELETE /identity/v3/projects/62894e9d07fa4c6fb2b99bb868612111 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:00.794759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899149a-c81a-491f-9bfa-ddc4167a7148 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:00.795207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899149a-c81a-491f-9bfa-ddc4167a7148 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:00.795655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899149a-c81a-491f-9bfa-ddc4167a7148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:00.842934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1899149a-c81a-491f-9bfa-ddc4167a7148 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:00.846271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1899149a-c81a-491f-9bfa-ddc4167a7148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:00.863960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:00.864940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:00.865523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:00.865819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] PATH_INFO: `/v3/projects/c8b0a28e82694b8cac7bfc07f439e9f2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:00.867649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b0a28e82694b8cac7bfc07f439e9f2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:00.870855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:00.941883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:00.965101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 983/1975] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:00.973103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b0a28e82694b8cac7bfc07f439e9f2', 'request_id': 'req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:00.975834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2d6cb-ed26-4287-bbd5-7ba38e65627b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:00.976197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2d6cb-ed26-4287-bbd5-7ba38e65627b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:00.976459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2d6cb-ed26-4287-bbd5-7ba38e65627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:00.987572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b0a28e82694b8cac7bfc07f439e9f2', 'request_id': 'req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:01.004065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b0a28e82694b8cac7bfc07f439e9f2', 'request_id': 'req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:01.005023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-93a2d6cb-ed26-4287-bbd5-7ba38e65627b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:01.006619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93a2d6cb-ed26-4287-bbd5-7ba38e65627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:01.025806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] The token cache is being invalidate because project c8b0a28e82694b8cac7bfc07f439e9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:01.026477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:01.027498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6a6a33ad-382c-4e4b-bb1b-b2e3569e2807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:01.031352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 993/1976] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:00 2022] DELETE /identity/v3/projects/c8b0a28e82694b8cac7bfc07f439e9f2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:01.036214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a959b-2696-45a2-8f2c-acd8c5660433 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.037842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a959b-2696-45a2-8f2c-acd8c5660433 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.038396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a959b-2696-45a2-8f2c-acd8c5660433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.080227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3f1a959b-2696-45a2-8f2c-acd8c5660433 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:01.081486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3f1a959b-2696-45a2-8f2c-acd8c5660433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:01.105836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:01.115713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 984/1977] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:01.116628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2d6cb-ed26-4287-bbd5-7ba38e65627b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.135809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2d6cb-ed26-4287-bbd5-7ba38e65627b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.144526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.144526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.144526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.144526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.145089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:01.145339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.148373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.165413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 985/1978] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:01.170124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.181922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479881-d3af-445e-8f66-ad5975c1b2d4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.187541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7126569-609e-4915-a23d-c02cec09f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.188351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7126569-609e-4915-a23d-c02cec09f59d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.188637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7126569-609e-4915-a23d-c02cec09f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.188919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7126569-609e-4915-a23d-c02cec09f59d admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.189715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7126569-609e-4915-a23d-c02cec09f59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.191842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7126569-609e-4915-a23d-c02cec09f59d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.194848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 994/1979] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:01.202078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e1af6-5197-40e6-90fd-480c50c62c30 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.202382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e1af6-5197-40e6-90fd-480c50c62c30 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.202654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e1af6-5197-40e6-90fd-480c50c62c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.241543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cb3e1af6-5197-40e6-90fd-480c50c62c30 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:01.242802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cb3e1af6-5197-40e6-90fd-480c50c62c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:01.250831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 986/1980] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:01.252278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7126569-609e-4915-a23d-c02cec09f59d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.320797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 995/1981] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:01.325322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e1af6-5197-40e6-90fd-480c50c62c30 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.336661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e1af6-5197-40e6-90fd-480c50c62c30 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.336983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7126569-609e-4915-a23d-c02cec09f59d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.343045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9850f-5a22-4a11-b1b0-19fd0d2d6379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.343634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.344091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9850f-5a22-4a11-b1b0-19fd0d2d6379 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.344540 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9850f-5a22-4a11-b1b0-19fd0d2d6379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.344673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.344875 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.345241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9850f-5a22-4a11-b1b0-19fd0d2d6379 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.345688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.346016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:01.346325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.347230 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9850f-5a22-4a11-b1b0-19fd0d2d6379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.347986 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.349556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9850f-5a22-4a11-b1b0-19fd0d2d6379 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.377727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 987/1982] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:01.378987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 996/1983] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:01.385141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9850f-5a22-4a11-b1b0-19fd0d2d6379 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.385695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.396548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9850f-5a22-4a11-b1b0-19fd0d2d6379 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.397351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9648-5d7c-4f60-bf8e-eab9dc955be0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.402687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99841-6afc-4502-9747-b5f263fdecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.403256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99841-6afc-4502-9747-b5f263fdecd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.403580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99841-6afc-4502-9747-b5f263fdecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.403864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99841-6afc-4502-9747-b5f263fdecd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.404210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff824c-9ea7-4566-847e-b623a1e778dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.404539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d99841-6afc-4502-9747-b5f263fdecd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.404909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff824c-9ea7-4566-847e-b623a1e778dc admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.405199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff824c-9ea7-4566-847e-b623a1e778dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.405478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff824c-9ea7-4566-847e-b623a1e778dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.406187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff824c-9ea7-4566-847e-b623a1e778dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.406500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d99841-6afc-4502-9747-b5f263fdecd8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.407816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff824c-9ea7-4566-847e-b623a1e778dc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.420379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 997/1984] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:01.425811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff824c-9ea7-4566-847e-b623a1e778dc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.437712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff824c-9ea7-4566-847e-b623a1e778dc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.443666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae906-51a2-4a66-b9aa-ecdbeb9b0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.444261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae906-51a2-4a66-b9aa-ecdbeb9b0e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.444676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae906-51a2-4a66-b9aa-ecdbeb9b0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.444949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae906-51a2-4a66-b9aa-ecdbeb9b0e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.445976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ae906-51a2-4a66-b9aa-ecdbeb9b0e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.451431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 988/1985] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:01.451618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ae906-51a2-4a66-b9aa-ecdbeb9b0e89 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.453371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99841-6afc-4502-9747-b5f263fdecd8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.464392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 998/1986] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:01.468658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae906-51a2-4a66-b9aa-ecdbeb9b0e89 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.485272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae906-51a2-4a66-b9aa-ecdbeb9b0e89 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.491061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:01.532526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99841-6afc-4502-9747-b5f263fdecd8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.537572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d44-9ee2-43ab-a700-7fdd1a7fcdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.538207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d44-9ee2-43ab-a700-7fdd1a7fcdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.538492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d44-9ee2-43ab-a700-7fdd1a7fcdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.538792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d44-9ee2-43ab-a700-7fdd1a7fcdb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.539503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887d44-9ee2-43ab-a700-7fdd1a7fcdb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.542583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887d44-9ee2-43ab-a700-7fdd1a7fcdb5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.566520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 989/1987] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:01.571689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d44-9ee2-43ab-a700-7fdd1a7fcdb5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.576040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2394c-403a-48f5-9db8-f181507097ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.576766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2394c-403a-48f5-9db8-f181507097ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.577031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2394c-403a-48f5-9db8-f181507097ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.577339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2394c-403a-48f5-9db8-f181507097ca admin admin] PATH_INFO: `/v3/projects/1942a04b5270497c8e1efbddc1d2f635/users/441efb5511284ea5b6273727e605529e/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.584722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d44-9ee2-43ab-a700-7fdd1a7fcdb5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.592281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9472da5-81a9-42da-9295-62d5e4fa0f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.592907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472da5-81a9-42da-9295-62d5e4fa0f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.593362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472da5-81a9-42da-9295-62d5e4fa0f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.593703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472da5-81a9-42da-9295-62d5e4fa0f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.594479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9472da5-81a9-42da-9295-62d5e4fa0f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.596245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9472da5-81a9-42da-9295-62d5e4fa0f57 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.607907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2394c-403a-48f5-9db8-f181507097ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1942a04b5270497c8e1efbddc1d2f635, user_id=441efb5511284ea5b6273727e605529e, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.609169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 990/1988] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:39:01.613393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9472da5-81a9-42da-9295-62d5e4fa0f57 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.613969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2394c-403a-48f5-9db8-f181507097ca admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.629604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9472da5-81a9-42da-9295-62d5e4fa0f57 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.635788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 999/1989] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:01 2022] PUT /identity/v3/projects/1942a04b5270497c8e1efbddc1d2f635/users/441efb5511284ea5b6273727e605529e/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:01.650577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60078a4-abf6-495d-bad9-03fa70b5670d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.651931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60078a4-abf6-495d-bad9-03fa70b5670d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.652573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60078a4-abf6-495d-bad9-03fa70b5670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.669488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:01.707916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d60078a4-abf6-495d-bad9-03fa70b5670d None None] MFA Rules not processed for user `441efb5511284ea5b6273727e605529e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:01.709913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d60078a4-abf6-495d-bad9-03fa70b5670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:01.762436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448fbaa-be50-4b69-bac5-e913fa8fc693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.763120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448fbaa-be50-4b69-bac5-e913fa8fc693 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.763517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448fbaa-be50-4b69-bac5-e913fa8fc693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.763827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448fbaa-be50-4b69-bac5-e913fa8fc693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.764680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448fbaa-be50-4b69-bac5-e913fa8fc693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.766964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448fbaa-be50-4b69-bac5-e913fa8fc693 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.786859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 991/1990] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:39:01.787760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448fbaa-be50-4b69-bac5-e913fa8fc693 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.806875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448fbaa-be50-4b69-bac5-e913fa8fc693 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.820614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1000/1991] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:01.821443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7123-56f6-4959-976e-2d4f465260b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.822269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7123-56f6-4959-976e-2d4f465260b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.822558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60078a4-abf6-495d-bad9-03fa70b5670d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.824257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7123-56f6-4959-976e-2d4f465260b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.824570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7123-56f6-4959-976e-2d4f465260b8 admin admin] PATH_INFO: `/v3/projects/7a9934d2cb4b43d682d1d4bf6b64b911/users/55e12a10e720431d8fa1f3331c468bd4/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.841781 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60078a4-abf6-495d-bad9-03fa70b5670d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:01.848378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06dc5b-cef6-4227-9021-9085047aa8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:01.850286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06dc5b-cef6-4227-9021-9085047aa8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.850286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06dc5b-cef6-4227-9021-9085047aa8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.850286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06dc5b-cef6-4227-9021-9085047aa8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.851546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06dc5b-cef6-4227-9021-9085047aa8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.852754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06dc5b-cef6-4227-9021-9085047aa8b4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.857639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7123-56f6-4959-976e-2d4f465260b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9934d2cb4b43d682d1d4bf6b64b911, user_id=55e12a10e720431d8fa1f3331c468bd4, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:01.860881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7123-56f6-4959-976e-2d4f465260b8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:01.889951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 992/1992] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:01 2022] PUT /identity/v3/projects/7a9934d2cb4b43d682d1d4bf6b64b911/users/55e12a10e720431d8fa1f3331c468bd4/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:01.896477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d7250-79fa-4270-9f3e-ad1f2d165d38 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:01.896812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d7250-79fa-4270-9f3e-ad1f2d165d38 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:01.897092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d7250-79fa-4270-9f3e-ad1f2d165d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:01.900582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1001/1993] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:01.904755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06dc5b-cef6-4227-9021-9085047aa8b4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:01.955773 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-857d7250-79fa-4270-9f3e-ad1f2d165d38 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:01.957637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-857d7250-79fa-4270-9f3e-ad1f2d165d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:02.074896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06dc5b-cef6-4227-9021-9085047aa8b4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:02.084506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf3fc6-0d38-4241-b470-dc380c9de880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:02.085669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3fc6-0d38-4241-b470-dc380c9de880 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:02.086152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3fc6-0d38-4241-b470-dc380c9de880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:02.086620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3fc6-0d38-4241-b470-dc380c9de880 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:02.087466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf3fc6-0d38-4241-b470-dc380c9de880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:02.089457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 993/1994] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:02.090644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf3fc6-0d38-4241-b470-dc380c9de880 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:02.110120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d7250-79fa-4270-9f3e-ad1f2d165d38 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:02.112378 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-857d7250-79fa-4270-9f3e-ad1f2d165d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:02.133546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1002/1995] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:01 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:02.137989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf3fc6-0d38-4241-b470-dc380c9de880 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:02.154606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:02.155310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf3fc6-0d38-4241-b470-dc380c9de880 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:02.161801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9ed4-91f4-43ce-976e-91412c7693b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:02.163671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9ed4-91f4-43ce-976e-91412c7693b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:02.164040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9ed4-91f4-43ce-976e-91412c7693b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:02.164346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9ed4-91f4-43ce-976e-91412c7693b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:02.166003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d9ed4-91f4-43ce-976e-91412c7693b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:02.171328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d9ed4-91f4-43ce-976e-91412c7693b7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:02.187505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1003/1996] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:02.196009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9ed4-91f4-43ce-976e-91412c7693b7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:02.211958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9ed4-91f4-43ce-976e-91412c7693b7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:02.222731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74424a4-cd08-463a-a107-8248c56209fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:02.222731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74424a4-cd08-463a-a107-8248c56209fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:02.223050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74424a4-cd08-463a-a107-8248c56209fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:02.223456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74424a4-cd08-463a-a107-8248c56209fe admin admin] PATH_INFO: `/v3/projects/fa9c1bc349c44ad3a6d1e31e832d6a49/users/b7eacda5106c48179b361bd8b357892d/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:02.227491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d7250-79fa-4270-9f3e-ad1f2d165d38 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:02.233114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f98f6-7cf4-4981-9074-190413f65f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:02.233981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f98f6-7cf4-4981-9074-190413f65f43 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:02.234339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f98f6-7cf4-4981-9074-190413f65f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:02.234693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f98f6-7cf4-4981-9074-190413f65f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:02.249340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f98f6-7cf4-4981-9074-190413f65f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:02.251347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f98f6-7cf4-4981-9074-190413f65f43 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:02.260401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74424a4-cd08-463a-a107-8248c56209fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9c1bc349c44ad3a6d1e31e832d6a49, user_id=b7eacda5106c48179b361bd8b357892d, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:02.264910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74424a4-cd08-463a-a107-8248c56209fe admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:02.266608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 994/1997] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:39:02.280535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1004/1998] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:02 2022] PUT /identity/v3/projects/fa9c1bc349c44ad3a6d1e31e832d6a49/users/b7eacda5106c48179b361bd8b357892d/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:02.284725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f98f6-7cf4-4981-9074-190413f65f43 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:02.305159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f98f6-7cf4-4981-9074-190413f65f43 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:02.399594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912769a6-906b-419f-a2fb-64f7ad0fb966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:02.401330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912769a6-906b-419f-a2fb-64f7ad0fb966 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:02.401330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912769a6-906b-419f-a2fb-64f7ad0fb966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:02.401701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912769a6-906b-419f-a2fb-64f7ad0fb966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:02.402413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912769a6-906b-419f-a2fb-64f7ad0fb966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:02.404834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912769a6-906b-419f-a2fb-64f7ad0fb966 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:02.422170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 995/1999] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:02.427933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74424a4-cd08-463a-a107-8248c56209fe admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:02.455245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74424a4-cd08-463a-a107-8248c56209fe admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:02.469317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:02.471345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:02.472436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:02.472641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] PATH_INFO: `/v3/projects/fa9c1bc349c44ad3a6d1e31e832d6a49/users/b7eacda5106c48179b361bd8b357892d/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:02.477343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9c1bc349c44ad3a6d1e31e832d6a49, user_id=b7eacda5106c48179b361bd8b357892d, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:02.483638 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:02.507496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1005/2000] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:02 2022] PUT /identity/v3/projects/fa9c1bc349c44ad3a6d1e31e832d6a49/users/b7eacda5106c48179b361bd8b357892d/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:02.531600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6d215-90dc-4739-a6e1-b236b06f3430 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:02.531944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6d215-90dc-4739-a6e1-b236b06f3430 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:02.532314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6d215-90dc-4739-a6e1-b236b06f3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:02.581426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-aee6d215-90dc-4739-a6e1-b236b06f3430 None None] MFA Rules not processed for user `b7eacda5106c48179b361bd8b357892d`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:02.583116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-aee6d215-90dc-4739-a6e1-b236b06f3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:02.690442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 996/2001] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:02.703644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:02.706297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:02.738372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:02.827231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe14a-abf4-4015-8a74-8208b64dad49 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:02.833817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:02.834816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:02.835272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:02.836008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:02.925597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:02.927785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:02.940462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1006/2002] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:03.495388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf663-697e-4a06-90a5-2d2d41dbff4d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:03.495981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf663-697e-4a06-90a5-2d2d41dbff4d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:03.496719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf663-697e-4a06-90a5-2d2d41dbff4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:03.535197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-34cdf663-697e-4a06-90a5-2d2d41dbff4d None None] MFA Rules not processed for user `55e12a10e720431d8fa1f3331c468bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:03.536778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-34cdf663-697e-4a06-90a5-2d2d41dbff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:03.595867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:03.647425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 997/2003] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:03.658107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:03.660641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:03.677195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f6872-4463-4c95-9bb7-52e32c1c99ae service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:03.681576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318227a-4fd0-4c28-86fe-23f5b9258b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:03.682720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318227a-4fd0-4c28-86fe-23f5b9258b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:03.683007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318227a-4fd0-4c28-86fe-23f5b9258b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:03.683283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318227a-4fd0-4c28-86fe-23f5b9258b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:03.693460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318227a-4fd0-4c28-86fe-23f5b9258b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:03.695183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318227a-4fd0-4c28-86fe-23f5b9258b2f service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:03.706830 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1007/2004] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:05.159907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b1ac9-c956-446d-ab7f-e3fa4546837a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:05.160474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b1ac9-c956-446d-ab7f-e3fa4546837a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:05.160474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b1ac9-c956-446d-ab7f-e3fa4546837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:05.184128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-201b1ac9-c956-446d-ab7f-e3fa4546837a None None] MFA Rules not processed for user `55e12a10e720431d8fa1f3331c468bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:05.185389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-201b1ac9-c956-446d-ab7f-e3fa4546837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:05.192680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 998/2005] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:06.584509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e8af-add0-45d6-90d3-011a93352ee6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:06.585567 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e8af-add0-45d6-90d3-011a93352ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:06.586274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e8af-add0-45d6-90d3-011a93352ee6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:06.588910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1008/2006] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:39:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:39:06.598698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5d2a-a9ee-4577-808a-54f589526350 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:06.599249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5d2a-a9ee-4577-808a-54f589526350 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:06.599584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5d2a-a9ee-4577-808a-54f589526350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:06.639807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0a0c5d2a-a9ee-4577-808a-54f589526350 None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:06.641247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0a0c5d2a-a9ee-4577-808a-54f589526350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:06.678666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39e8af-add0-45d6-90d3-011a93352ee6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:06.682041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3d39e8af-add0-45d6-90d3-011a93352ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:06.734318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 999/2007] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:06.782493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39e8af-add0-45d6-90d3-011a93352ee6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:06.787295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:06.788065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:06.788375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:06.788654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] PATH_INFO: `/v3/users/eb98fec3c7394d889b77544ac52643b8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:06.789865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb98fec3c7394d889b77544ac52643b8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:06.792505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:06.846601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb98fec3c7394d889b77544ac52643b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:06.857516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb98fec3c7394d889b77544ac52643b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:06.862654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:06.874844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb98fec3c7394d889b77544ac52643b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:06.875660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb98fec3c7394d889b77544ac52643b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:06.889304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb98fec3c7394d889b77544ac52643b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:06.895536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1009/2008] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:06 2022] DELETE /identity/v3/users/eb98fec3c7394d889b77544ac52643b8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:06.936181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c5d2a-a9ee-4577-808a-54f589526350 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:06.937968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0a0c5d2a-a9ee-4577-808a-54f589526350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:06.952599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c5d2a-a9ee-4577-808a-54f589526350 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:07.026241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e62b9-0469-4eb3-963b-01b78b5cef53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:07.026877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e62b9-0469-4eb3-963b-01b78b5cef53 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.027159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e62b9-0469-4eb3-963b-01b78b5cef53 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.027470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e62b9-0469-4eb3-963b-01b78b5cef53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.029442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cd8e62b9-0469-4eb3-963b-01b78b5cef53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:07.044366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e62b9-0469-4eb3-963b-01b78b5cef53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:07.046014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e62b9-0469-4eb3-963b-01b78b5cef53 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:07.060495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1000/2009] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:07.092681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:07.094981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:07.165491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720c96a-84af-4055-abe8-624c88bb4a7c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:07.171291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:07.171985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.172278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.172550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] PATH_INFO: `/v3/projects/b8c601a28e8946f284afca9d3237adc6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.173721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c601a28e8946f284afca9d3237adc6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:07.175930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:07.222207 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c601a28e8946f284afca9d3237adc6', 'request_id': 'req-6c82e0f5-c10c-414d-962c-f988f778ef5a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:07.230000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c601a28e8946f284afca9d3237adc6', 'request_id': 'req-6c82e0f5-c10c-414d-962c-f988f778ef5a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:07.236142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c601a28e8946f284afca9d3237adc6', 'request_id': 'req-6c82e0f5-c10c-414d-962c-f988f778ef5a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:07.248663 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] The token cache is being invalidate because project b8c601a28e8946f284afca9d3237adc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:07.248958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:07.250420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c82e0f5-c10c-414d-962c-f988f778ef5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:07.251924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1010/2010] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:07 2022] DELETE /identity/v3/projects/b8c601a28e8946f284afca9d3237adc6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:07.256880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60e858-a1fb-4cce-af3f-a8c921a2535d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.257172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60e858-a1fb-4cce-af3f-a8c921a2535d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.257451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60e858-a1fb-4cce-af3f-a8c921a2535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.277153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8e60e858-a1fb-4cce-af3f-a8c921a2535d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:07.278344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8e60e858-a1fb-4cce-af3f-a8c921a2535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:07.332455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:07.348592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1001/2011] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:07.357227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8944fe3-3747-4140-bd77-dbb218599c17 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.357558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8944fe3-3747-4140-bd77-dbb218599c17 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.357820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8944fe3-3747-4140-bd77-dbb218599c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.379347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c8944fe3-3747-4140-bd77-dbb218599c17 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:07.380632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c8944fe3-3747-4140-bd77-dbb218599c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:07.395736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1011/2012] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:07.396364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60e858-a1fb-4cce-af3f-a8c921a2535d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:07.410835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60e858-a1fb-4cce-af3f-a8c921a2535d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:07.416416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:07.417591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.417946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.419157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.419157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:07.419350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:07.421433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:07.454151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1002/2013] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:07.458202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8944fe3-3747-4140-bd77-dbb218599c17 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:07.489345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8944fe3-3747-4140-bd77-dbb218599c17 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:07.494795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed8a1a-72b5-4512-b255-5cd3414b313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:07.496222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed8a1a-72b5-4512-b255-5cd3414b313d admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.496521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed8a1a-72b5-4512-b255-5cd3414b313d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.496801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed8a1a-72b5-4512-b255-5cd3414b313d admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.497480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed8a1a-72b5-4512-b255-5cd3414b313d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:07.501508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed8a1a-72b5-4512-b255-5cd3414b313d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:07.547622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1012/2014] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:07 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:07.552270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:07.565637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3605202-5b99-4eba-a1ba-a118af571615 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:07.643736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7fa1d-18d5-4789-b3c4-4b6d9a20298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:07.645335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7fa1d-18d5-4789-b3c4-4b6d9a20298c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.646808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7fa1d-18d5-4789-b3c4-4b6d9a20298c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.647278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7fa1d-18d5-4789-b3c4-4b6d9a20298c admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.648173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7fa1d-18d5-4789-b3c4-4b6d9a20298c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:07.652407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7fa1d-18d5-4789-b3c4-4b6d9a20298c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:07.681739 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1003/2015] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:07 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:07.686144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed8a1a-72b5-4512-b255-5cd3414b313d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:07.699730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed8a1a-72b5-4512-b255-5cd3414b313d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:07.705546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5fe2-d35c-447f-876a-a95edaf29822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:07.706239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5fe2-d35c-447f-876a-a95edaf29822 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.706528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5fe2-d35c-447f-876a-a95edaf29822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.706831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5fe2-d35c-447f-876a-a95edaf29822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.707624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5fe2-d35c-447f-876a-a95edaf29822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:07.709486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5fe2-d35c-447f-876a-a95edaf29822 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:07.721124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1013/2016] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:07.725287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7fa1d-18d5-4789-b3c4-4b6d9a20298c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:07.736033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7fa1d-18d5-4789-b3c4-4b6d9a20298c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:07.747238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013313b-1d78-4a0e-9e05-a3a2e79ab20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:07.748102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013313b-1d78-4a0e-9e05-a3a2e79ab20c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.748335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013313b-1d78-4a0e-9e05-a3a2e79ab20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.749468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013313b-1d78-4a0e-9e05-a3a2e79ab20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.750582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013313b-1d78-4a0e-9e05-a3a2e79ab20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:07.753480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013313b-1d78-4a0e-9e05-a3a2e79ab20c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:07.768568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1004/2017] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:07.773340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5fe2-d35c-447f-876a-a95edaf29822 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:07.788702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5fe2-d35c-447f-876a-a95edaf29822 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:07.808456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3428d4-d36e-4a6c-9088-06c3d2d33fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:07.809364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3428d4-d36e-4a6c-9088-06c3d2d33fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.809825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3428d4-d36e-4a6c-9088-06c3d2d33fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.810108 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3428d4-d36e-4a6c-9088-06c3d2d33fba admin admin] PATH_INFO: `/v3/projects/8061b35475744247bfe213ebd2831f01/users/665acae150e241ea8ba37d3dbdb4b812/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.831129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3428d4-d36e-4a6c-9088-06c3d2d33fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8061b35475744247bfe213ebd2831f01, user_id=665acae150e241ea8ba37d3dbdb4b812, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:07.834520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3428d4-d36e-4a6c-9088-06c3d2d33fba admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:07.858645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1014/2018] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:07 2022] PUT /identity/v3/projects/8061b35475744247bfe213ebd2831f01/users/665acae150e241ea8ba37d3dbdb4b812/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:07.869509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7b60-ed1f-4294-a341-28f3f1b20808 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:07.869509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7b60-ed1f-4294-a341-28f3f1b20808 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:07.869509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7b60-ed1f-4294-a341-28f3f1b20808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:07.903989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-698c7b60-ed1f-4294-a341-28f3f1b20808 None None] MFA Rules not processed for user `665acae150e241ea8ba37d3dbdb4b812`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:07.905250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-698c7b60-ed1f-4294-a341-28f3f1b20808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:07.979827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1005/2019] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:07.984321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3428d4-d36e-4a6c-9088-06c3d2d33fba admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:07.988853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:08.052018 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3428d4-d36e-4a6c-9088-06c3d2d33fba admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:08.056778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac62c5-59dd-4936-b9a9-cef56dd35bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:08.057924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac62c5-59dd-4936-b9a9-cef56dd35bcb admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.058212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac62c5-59dd-4936-b9a9-cef56dd35bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.058489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac62c5-59dd-4936-b9a9-cef56dd35bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.059166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac62c5-59dd-4936-b9a9-cef56dd35bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:08.061153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac62c5-59dd-4936-b9a9-cef56dd35bcb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:08.098834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1015/2020] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:07 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:08.103234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7b60-ed1f-4294-a341-28f3f1b20808 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:08.115695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7b60-ed1f-4294-a341-28f3f1b20808 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:08.179300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:08.197248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcacc0-f9d0-432a-9b8b-a13f6ff5e15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:08.198439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcacc0-f9d0-432a-9b8b-a13f6ff5e15b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.198720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcacc0-f9d0-432a-9b8b-a13f6ff5e15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.198992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcacc0-f9d0-432a-9b8b-a13f6ff5e15b admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.199706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcacc0-f9d0-432a-9b8b-a13f6ff5e15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:08.202267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcacc0-f9d0-432a-9b8b-a13f6ff5e15b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:08.228420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1006/2021] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:08 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:08.232833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac62c5-59dd-4936-b9a9-cef56dd35bcb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:08.246049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac62c5-59dd-4936-b9a9-cef56dd35bcb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:08.251475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba541-f726-4c26-993b-257c274d837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:08.252149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba541-f726-4c26-993b-257c274d837f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.252434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba541-f726-4c26-993b-257c274d837f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.252709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba541-f726-4c26-993b-257c274d837f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.253442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bba541-f726-4c26-993b-257c274d837f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:08.255062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bba541-f726-4c26-993b-257c274d837f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:08.269151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1016/2022] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:08.273237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcacc0-f9d0-432a-9b8b-a13f6ff5e15b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:08.283638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcacc0-f9d0-432a-9b8b-a13f6ff5e15b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:08.288700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717d0eb-1bb5-49bf-9a3e-05de8f564f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:08.289273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717d0eb-1bb5-49bf-9a3e-05de8f564f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.290734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717d0eb-1bb5-49bf-9a3e-05de8f564f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.290734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717d0eb-1bb5-49bf-9a3e-05de8f564f41 admin admin] PATH_INFO: `/v3/projects/f8ff1cb0303a494383f2bd5b3b988a5c/users/f636dfa3bd5e460f9f3e9436cb22936b/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.307765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717d0eb-1bb5-49bf-9a3e-05de8f564f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ff1cb0303a494383f2bd5b3b988a5c, user_id=f636dfa3bd5e460f9f3e9436cb22936b, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:08.310428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717d0eb-1bb5-49bf-9a3e-05de8f564f41 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:08.325622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1007/2023] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:08 2022] PUT /identity/v3/projects/f8ff1cb0303a494383f2bd5b3b988a5c/users/f636dfa3bd5e460f9f3e9436cb22936b/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:08.329366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba541-f726-4c26-993b-257c274d837f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:08.339463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba541-f726-4c26-993b-257c274d837f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:08.409160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5abc9-17f1-4dd1-b143-694e5d721074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:08.410079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5abc9-17f1-4dd1-b143-694e5d721074 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.410419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5abc9-17f1-4dd1-b143-694e5d721074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.410704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5abc9-17f1-4dd1-b143-694e5d721074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.411441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5abc9-17f1-4dd1-b143-694e5d721074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:08.413083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5abc9-17f1-4dd1-b143-694e5d721074 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:08.430012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1017/2024] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:08.431722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717d0eb-1bb5-49bf-9a3e-05de8f564f41 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:08.443965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717d0eb-1bb5-49bf-9a3e-05de8f564f41 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:08.451575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:08.452356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.452703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.453107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] PATH_INFO: `/v3/projects/f8ff1cb0303a494383f2bd5b3b988a5c/users/f636dfa3bd5e460f9f3e9436cb22936b/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.455152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ff1cb0303a494383f2bd5b3b988a5c, user_id=f636dfa3bd5e460f9f3e9436cb22936b, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:08.457898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:08.475017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1008/2025] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:08 2022] PUT /identity/v3/projects/f8ff1cb0303a494383f2bd5b3b988a5c/users/f636dfa3bd5e460f9f3e9436cb22936b/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:08.486831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b3166-6256-40ab-bb05-4a9e885b0b7e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.487125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b3166-6256-40ab-bb05-4a9e885b0b7e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.487453 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b3166-6256-40ab-bb05-4a9e885b0b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.520569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-668b3166-6256-40ab-bb05-4a9e885b0b7e None None] MFA Rules not processed for user `f636dfa3bd5e460f9f3e9436cb22936b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:08.521811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-668b3166-6256-40ab-bb05-4a9e885b0b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:08.624716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:08.637613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1018/2026] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:08.652187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:08.654562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:08.746999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0934-d2ec-4b2f-ba59-357d81f75e01 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:08.752574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:08.752966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.753362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.753548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.774126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:08.777437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:08.802651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1009/2027] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:08.874359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b3166-6256-40ab-bb05-4a9e885b0b7e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:08.885952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b3166-6256-40ab-bb05-4a9e885b0b7e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:08.889948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:08.890875 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:08.891183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:08.891488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:08.973388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:08.974842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:08.984840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1019/2028] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:09.012725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:09.014157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:09.026233 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9cd78-3d81-4220-87e6-e6fc8038d434 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:09.030497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27045cd3-ffec-4042-ab6a-7b2fc3ca5025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:09.031393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27045cd3-ffec-4042-ab6a-7b2fc3ca5025 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:09.031720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27045cd3-ffec-4042-ab6a-7b2fc3ca5025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:09.032015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27045cd3-ffec-4042-ab6a-7b2fc3ca5025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:09.034225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-27045cd3-ffec-4042-ab6a-7b2fc3ca5025 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:09.120132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27045cd3-ffec-4042-ab6a-7b2fc3ca5025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:09.125463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27045cd3-ffec-4042-ab6a-7b2fc3ca5025 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:09.149633 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1010/2029] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:15.282176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:15.284258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:15.362713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cc5c-9433-4046-a5ca-86675fe70324 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:15.367538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:15.368194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:15.368824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:15.368824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] PATH_INFO: `/v3/users/441efb5511284ea5b6273727e605529e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:15.369917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441efb5511284ea5b6273727e605529e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:15.371904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:15.431521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441efb5511284ea5b6273727e605529e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:15.439794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441efb5511284ea5b6273727e605529e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:15.446657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441efb5511284ea5b6273727e605529e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:15.447274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441efb5511284ea5b6273727e605529e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:15.459930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441efb5511284ea5b6273727e605529e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:15.465872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1020/2030] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:15 2022] DELETE /identity/v3/users/441efb5511284ea5b6273727e605529e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:15.470548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14155d18-e23a-4ebc-af0e-26b9e7b0215a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:15.471004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14155d18-e23a-4ebc-af0e-26b9e7b0215a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:15.471117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14155d18-e23a-4ebc-af0e-26b9e7b0215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:15.491175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-14155d18-e23a-4ebc-af0e-26b9e7b0215a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:15.492404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-14155d18-e23a-4ebc-af0e-26b9e7b0215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:15.525771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:15.556944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1011/2031] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:15.567237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:15.568712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:15.587235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:15.628335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b275c-79be-4ced-8597-8570487fe365 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:15.631963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:15.632581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:15.632859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:15.633129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:15.642286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:15.643757 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:15.653293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1021/2032] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:16.013864 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14155d18-e23a-4ebc-af0e-26b9e7b0215a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:16.015679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-14155d18-e23a-4ebc-af0e-26b9e7b0215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:16.046197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14155d18-e23a-4ebc-af0e-26b9e7b0215a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:16.057953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:16.060134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:16.065437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:16.066460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:16.066949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:16.067626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] PATH_INFO: `/v3/projects/1942a04b5270497c8e1efbddc1d2f635` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:16.070162 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1942a04b5270497c8e1efbddc1d2f635)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:16.072547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:16.074906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65965074-dd60-4f51-b06a-2db1fab6e296 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:16.081705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:16.082752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:16.083248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:16.083697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] PATH_INFO: `/v3/users/665acae150e241ea8ba37d3dbdb4b812` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:16.085210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665acae150e241ea8ba37d3dbdb4b812)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:16.088709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:16.163401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1942a04b5270497c8e1efbddc1d2f635', 'request_id': 'req-02540ec3-e11d-40d6-ab86-7085e4ecb11a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.164950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665acae150e241ea8ba37d3dbdb4b812'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.171914 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1942a04b5270497c8e1efbddc1d2f635', 'request_id': 'req-02540ec3-e11d-40d6-ab86-7085e4ecb11a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.175176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665acae150e241ea8ba37d3dbdb4b812'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.182121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1942a04b5270497c8e1efbddc1d2f635', 'request_id': 'req-02540ec3-e11d-40d6-ab86-7085e4ecb11a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.186524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665acae150e241ea8ba37d3dbdb4b812'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.187497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665acae150e241ea8ba37d3dbdb4b812'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.198083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] The token cache is being invalidate because project 1942a04b5270497c8e1efbddc1d2f635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:16.198437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.199077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.201808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1012/2033] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:16 2022] DELETE /identity/v3/projects/1942a04b5270497c8e1efbddc1d2f635 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:16.202089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ac4dff5a-c633-498a-a71a-1271f4337ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665acae150e241ea8ba37d3dbdb4b812'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.206090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:16.207430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:16.208631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1022/2034] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:16 2022] DELETE /identity/v3/users/665acae150e241ea8ba37d3dbdb4b812 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:16.213125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5abd4-331b-4592-be05-1617f4ded680 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:16.213423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5abd4-331b-4592-be05-1617f4ded680 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:16.213694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5abd4-331b-4592-be05-1617f4ded680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:16.234948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-50c5abd4-331b-4592-be05-1617f4ded680 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:16.236196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-50c5abd4-331b-4592-be05-1617f4ded680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:16.285624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02540ec3-e11d-40d6-ab86-7085e4ecb11a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:16.293686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1023/2035] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:16.304433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5abd4-331b-4592-be05-1617f4ded680 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:16.306197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-50c5abd4-331b-4592-be05-1617f4ded680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:16.340743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:16.348117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:16.348860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:16.349148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:16.349534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] PATH_INFO: `/v3/users/b7eacda5106c48179b361bd8b357892d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:16.350672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7eacda5106c48179b361bd8b357892d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:16.352782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:16.364594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:16.369304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5abd4-331b-4592-be05-1617f4ded680 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:16.373502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:16.374475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:16.375136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:16.375699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:16.385971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:16.387690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:16.401833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1024/2036] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:16.405423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7eacda5106c48179b361bd8b357892d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.414835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7eacda5106c48179b361bd8b357892d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.415734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7eacda5106c48179b361bd8b357892d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.432340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7eacda5106c48179b361bd8b357892d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.433419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7eacda5106c48179b361bd8b357892d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:16.455470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1013/2037] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:16 2022] DELETE /identity/v3/users/b7eacda5106c48179b361bd8b357892d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:16.910682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:16.912213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:16.927232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a995f5-2305-4c81-b691-7637c8ddf622 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:16.990034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:16.991774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:17.006688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.007465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.008036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.008195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] PATH_INFO: `/v3/projects/8061b35475744247bfe213ebd2831f01` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.009366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8061b35475744247bfe213ebd2831f01)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.011316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.067576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8061b35475744247bfe213ebd2831f01', 'request_id': 'req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.070393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0d5fc-0d23-4705-bda3-cdab5184cea5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.079134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8061b35475744247bfe213ebd2831f01', 'request_id': 'req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.085877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8061b35475744247bfe213ebd2831f01', 'request_id': 'req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.100162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] The token cache is being invalidate because project 8061b35475744247bfe213ebd2831f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:17.100473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.101144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.103178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1025/2038] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:16 2022] DELETE /identity/v3/projects/8061b35475744247bfe213ebd2831f01 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:17.108522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:17.109966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:17.159485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.160247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.160601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.160949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] PATH_INFO: `/v3/projects/fa9c1bc349c44ad3a6d1e31e832d6a49` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.162147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9c1bc349c44ad3a6d1e31e832d6a49)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.164156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.181057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2c0a-4971-42ae-8e27-a6dcfd1d1593 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.195190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.196274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.196899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.197084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] PATH_INFO: `/v3/users/f636dfa3bd5e460f9f3e9436cb22936b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.199009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f636dfa3bd5e460f9f3e9436cb22936b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.202403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.211346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:17.222207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:17.241992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9c1bc349c44ad3a6d1e31e832d6a49', 'request_id': 'req-949fa05d-1717-4152-98b5-1a0b8a01c5f3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.251006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9c1bc349c44ad3a6d1e31e832d6a49', 'request_id': 'req-949fa05d-1717-4152-98b5-1a0b8a01c5f3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.264681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9c1bc349c44ad3a6d1e31e832d6a49', 'request_id': 'req-949fa05d-1717-4152-98b5-1a0b8a01c5f3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.282645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f636dfa3bd5e460f9f3e9436cb22936b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.285691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] The token cache is being invalidate because project fa9c1bc349c44ad3a6d1e31e832d6a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:17.286948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.287758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-949fa05d-1717-4152-98b5-1a0b8a01c5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.289813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1014/2039] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:16 2022] DELETE /identity/v3/projects/fa9c1bc349c44ad3a6d1e31e832d6a49 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:17.296208 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f636dfa3bd5e460f9f3e9436cb22936b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.296766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27542-b924-42b2-96fd-71fb439ee7d6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.296766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27542-b924-42b2-96fd-71fb439ee7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.297061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27542-b924-42b2-96fd-71fb439ee7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.310119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f636dfa3bd5e460f9f3e9436cb22936b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.311043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f636dfa3bd5e460f9f3e9436cb22936b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.319462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f2b27542-b924-42b2-96fd-71fb439ee7d6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:17.321123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f2b27542-b924-42b2-96fd-71fb439ee7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:17.326283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0e04ad85-b70b-4bcd-9105-39794b57fc2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f636dfa3bd5e460f9f3e9436cb22936b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.336791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1026/2040] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:17 2022] DELETE /identity/v3/users/f636dfa3bd5e460f9f3e9436cb22936b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:17.404003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1015/2041] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:17.412858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4271-5e4f-42b0-9e3a-b9321a37a4ab None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.413159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4271-5e4f-42b0-9e3a-b9321a37a4ab None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.413426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4271-5e4f-42b0-9e3a-b9321a37a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.436916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bebf4271-5e4f-42b0-9e3a-b9321a37a4ab None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:17.438251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bebf4271-5e4f-42b0-9e3a-b9321a37a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:17.515662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1027/2042] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:17.518265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b27542-b924-42b2-96fd-71fb439ee7d6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:17.529266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b27542-b924-42b2-96fd-71fb439ee7d6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.534771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.535256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.535490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.535768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.536485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:17.536793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.538623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.557368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1016/2043] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:39:17.565487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4271-5e4f-42b0-9e3a-b9321a37a4ab None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:17.578605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4271-5e4f-42b0-9e3a-b9321a37a4ab None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.585941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.585941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.585941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.586448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.587205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.589310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.626136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1028/2044] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:17 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:17.630666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:17.645024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb93c91-6804-4b40-990a-b1724b3f0419 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.693429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:17.695241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:17.745718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51480f7b-ee76-4245-aa02-f8bd83bc3f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.747239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480f7b-ee76-4245-aa02-f8bd83bc3f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.748447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480f7b-ee76-4245-aa02-f8bd83bc3f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.749086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480f7b-ee76-4245-aa02-f8bd83bc3f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.750613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51480f7b-ee76-4245-aa02-f8bd83bc3f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.752770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51480f7b-ee76-4245-aa02-f8bd83bc3f31 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.784394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1017/2045] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:17 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:17.788759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51480f7b-ee76-4245-aa02-f8bd83bc3f31 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:17.805331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51480f7b-ee76-4245-aa02-f8bd83bc3f31 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.811461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bac44-2692-490c-8dab-bb506c5add8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.812224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bac44-2692-490c-8dab-bb506c5add8c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.812579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bac44-2692-490c-8dab-bb506c5add8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.812927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bac44-2692-490c-8dab-bb506c5add8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.813715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bac44-2692-490c-8dab-bb506c5add8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.815994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bac44-2692-490c-8dab-bb506c5add8c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.829187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1018/2046] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:39:17.840820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bac44-2692-490c-8dab-bb506c5add8c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:17.848990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e3eba-b40d-4b3d-8239-bc90067bbf66 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.855140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.856009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.857724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.857975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] PATH_INFO: `/v3/projects/f8ff1cb0303a494383f2bd5b3b988a5c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.860041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ff1cb0303a494383f2bd5b3b988a5c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.861884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bac44-2692-490c-8dab-bb506c5add8c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.862807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.865853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:17.869772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae465067-f885-477c-b1d8-17e92930337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.870417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465067-f885-477c-b1d8-17e92930337e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.870702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465067-f885-477c-b1d8-17e92930337e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.870982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465067-f885-477c-b1d8-17e92930337e admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.871719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae465067-f885-477c-b1d8-17e92930337e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.876191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae465067-f885-477c-b1d8-17e92930337e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.890220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1019/2047] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:17.895020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae465067-f885-477c-b1d8-17e92930337e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:17.907277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae465067-f885-477c-b1d8-17e92930337e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:17.914175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ab8a6-f7b6-4e67-bf79-91b0a006db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:17.915321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab8a6-f7b6-4e67-bf79-91b0a006db55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.915696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab8a6-f7b6-4e67-bf79-91b0a006db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.916061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab8a6-f7b6-4e67-bf79-91b0a006db55 admin admin] PATH_INFO: `/v3/projects/1744660a89e945718645cfa877b689ba/users/65c3f45a95074e1b80648358fa644caa/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.939543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ab8a6-f7b6-4e67-bf79-91b0a006db55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1744660a89e945718645cfa877b689ba, user_id=65c3f45a95074e1b80648358fa644caa, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:17.943087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ff1cb0303a494383f2bd5b3b988a5c', 'request_id': 'req-83ec36c6-67af-4940-97be-c67160c1bb19'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.943227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ab8a6-f7b6-4e67-bf79-91b0a006db55 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:17.947837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:17.954723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ff1cb0303a494383f2bd5b3b988a5c', 'request_id': 'req-83ec36c6-67af-4940-97be-c67160c1bb19'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.962295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ff1cb0303a494383f2bd5b3b988a5c', 'request_id': 'req-83ec36c6-67af-4940-97be-c67160c1bb19'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.983482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1020/2048] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:17 2022] PUT /identity/v3/projects/1744660a89e945718645cfa877b689ba/users/65c3f45a95074e1b80648358fa644caa/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:17.983688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] The token cache is being invalidate because project f8ff1cb0303a494383f2bd5b3b988a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:17.983688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.983688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83ec36c6-67af-4940-97be-c67160c1bb19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:17.983688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1029/2049] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:17 2022] DELETE /identity/v3/projects/f8ff1cb0303a494383f2bd5b3b988a5c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:17.984018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb8f16-3019-44ee-8b09-4a6ddcab94a0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.984018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb8f16-3019-44ee-8b09-4a6ddcab94a0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.984018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb8f16-3019-44ee-8b09-4a6ddcab94a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:17.994628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0c8c1-2e59-4946-aff1-973f09d571c1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:17.995739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0c8c1-2e59-4946-aff1-973f09d571c1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:17.995739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0c8c1-2e59-4946-aff1-973f09d571c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.005173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-48cb8f16-3019-44ee-8b09-4a6ddcab94a0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:18.006624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-48cb8f16-3019-44ee-8b09-4a6ddcab94a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.025333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3ff0c8c1-2e59-4946-aff1-973f09d571c1 None None] MFA Rules not processed for user `65c3f45a95074e1b80648358fa644caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:18.026740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3ff0c8c1-2e59-4946-aff1-973f09d571c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.077300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1021/2050] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:18.086398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91bacb-610c-46b4-9cf1-c123e6b9148f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.086683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91bacb-610c-46b4-9cf1-c123e6b9148f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.086963 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91bacb-610c-46b4-9cf1-c123e6b9148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.100015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1030/2051] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:18.110322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4b91bacb-610c-46b4-9cf1-c123e6b9148f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:18.111742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4b91bacb-610c-46b4-9cf1-c123e6b9148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.113205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0c8c1-2e59-4946-aff1-973f09d571c1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.114492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3ff0c8c1-2e59-4946-aff1-973f09d571c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.121074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1022/2052] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:18.126506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91bacb-610c-46b4-9cf1-c123e6b9148f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.137238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91bacb-610c-46b4-9cf1-c123e6b9148f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.142455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.143088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.143410 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.143662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.144362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:18.144667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.146290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.161390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1023/2053] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:39:18.165783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.177929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983d075-2338-4a74-bbc9-8a9fab7654ce admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.182841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebe48-d771-4e50-9009-5b0a446da0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.183514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebe48-d771-4e50-9009-5b0a446da0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.183787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebe48-d771-4e50-9009-5b0a446da0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.184060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebe48-d771-4e50-9009-5b0a446da0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.184727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ebe48-d771-4e50-9009-5b0a446da0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.186647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ebe48-d771-4e50-9009-5b0a446da0fa admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.189009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0c8c1-2e59-4946-aff1-973f09d571c1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.193803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.199642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.200070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.200360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.210385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.211873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.221050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1024/2054] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:18 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:18.222178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebe48-d771-4e50-9009-5b0a446da0fa admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.226368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1031/2055] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:39:18.250926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.252653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.267041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96207f-2b45-4fb1-9d0d-0e86848a2323 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.289388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:18.300542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebe48-d771-4e50-9009-5b0a446da0fa admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.305342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b506bd1-2682-4ee9-85bd-745ef265be4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.305964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506bd1-2682-4ee9-85bd-745ef265be4f admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.306248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506bd1-2682-4ee9-85bd-745ef265be4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.306524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506bd1-2682-4ee9-85bd-745ef265be4f admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.307186 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b506bd1-2682-4ee9-85bd-745ef265be4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.309193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b506bd1-2682-4ee9-85bd-745ef265be4f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.329910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.330482 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.330763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.331036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] PATH_INFO: `/v3/users/65c3f45a95074e1b80648358fa644caa` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.332269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c3f45a95074e1b80648358fa644caa)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.333931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1025/2056] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:18 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:18.334176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.337968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b506bd1-2682-4ee9-85bd-745ef265be4f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.350037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b506bd1-2682-4ee9-85bd-745ef265be4f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.355563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678f2a-8afe-4fec-9138-96ade027ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.356557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678f2a-8afe-4fec-9138-96ade027ef5c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.357823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678f2a-8afe-4fec-9138-96ade027ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.358117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678f2a-8afe-4fec-9138-96ade027ef5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.359450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0678f2a-8afe-4fec-9138-96ade027ef5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.361078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0678f2a-8afe-4fec-9138-96ade027ef5c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.375285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1026/2057] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:39:18.376780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678f2a-8afe-4fec-9138-96ade027ef5c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.384419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c3f45a95074e1b80648358fa644caa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:18.386470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678f2a-8afe-4fec-9138-96ade027ef5c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.391988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4dd5b-967f-4cd5-b888-a6e0f420155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.393424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4dd5b-967f-4cd5-b888-a6e0f420155a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.393735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4dd5b-967f-4cd5-b888-a6e0f420155a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.394015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4dd5b-967f-4cd5-b888-a6e0f420155a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.394714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4dd5b-967f-4cd5-b888-a6e0f420155a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.395864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c3f45a95074e1b80648358fa644caa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:18.396358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4dd5b-967f-4cd5-b888-a6e0f420155a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.404414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c3f45a95074e1b80648358fa644caa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:18.405254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c3f45a95074e1b80648358fa644caa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:18.408413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1027/2058] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:18.412583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4dd5b-967f-4cd5-b888-a6e0f420155a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.419180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a659b8c2-939f-445a-a250-8f62dd3a19d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c3f45a95074e1b80648358fa644caa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:18.425951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4dd5b-967f-4cd5-b888-a6e0f420155a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.426793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1032/2059] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:18 2022] DELETE /identity/v3/users/65c3f45a95074e1b80648358fa644caa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:18.431229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9cf13-3ac7-4202-ac0e-8e79e9532ba7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.431541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9cf13-3ac7-4202-ac0e-8e79e9532ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.431844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9cf13-3ac7-4202-ac0e-8e79e9532ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.449728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:18.453376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-98a9cf13-3ac7-4202-ac0e-8e79e9532ba7 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:18.454594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-98a9cf13-3ac7-4202-ac0e-8e79e9532ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.499790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d22a30-9a96-4bc1-9ecf-2c6ed082de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.500818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d22a30-9a96-4bc1-9ecf-2c6ed082de5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.501103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d22a30-9a96-4bc1-9ecf-2c6ed082de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.501528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d22a30-9a96-4bc1-9ecf-2c6ed082de5d admin admin] PATH_INFO: `/v3/projects/821c72d13aaf4f8d8699e19e713f617a/users/71a68dd42aaf47e4a533cbc14a2af176/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.520159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d22a30-9a96-4bc1-9ecf-2c6ed082de5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=821c72d13aaf4f8d8699e19e713f617a, user_id=71a68dd42aaf47e4a533cbc14a2af176, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.523038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d22a30-9a96-4bc1-9ecf-2c6ed082de5d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.530084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1033/2060] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:18.540538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9cf13-3ac7-4202-ac0e-8e79e9532ba7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.542510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1028/2061] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:18 2022] PUT /identity/v3/projects/821c72d13aaf4f8d8699e19e713f617a/users/71a68dd42aaf47e4a533cbc14a2af176/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:18.543670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-98a9cf13-3ac7-4202-ac0e-8e79e9532ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.555363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9989-99cc-4a6f-8d10-9ff2d3eaca92 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.555575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9989-99cc-4a6f-8d10-9ff2d3eaca92 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.555959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9989-99cc-4a6f-8d10-9ff2d3eaca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.600343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:18.605728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-522d9989-99cc-4a6f-8d10-9ff2d3eaca92 None None] MFA Rules not processed for user `71a68dd42aaf47e4a533cbc14a2af176`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:18.607047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-522d9989-99cc-4a6f-8d10-9ff2d3eaca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.613845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9cf13-3ac7-4202-ac0e-8e79e9532ba7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.666459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388f60e-c08e-421f-b3c6-83a924b7282e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.667087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f60e-c08e-421f-b3c6-83a924b7282e service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.667387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f60e-c08e-421f-b3c6-83a924b7282e service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.667668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f60e-c08e-421f-b3c6-83a924b7282e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.674262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1029/2062] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:18.679030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9989-99cc-4a6f-8d10-9ff2d3eaca92 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.680401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-522d9989-99cc-4a6f-8d10-9ff2d3eaca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:18.733335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388f60e-c08e-421f-b3c6-83a924b7282e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.734772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388f60e-c08e-421f-b3c6-83a924b7282e service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.744391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1034/2063] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:39:18.748472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9989-99cc-4a6f-8d10-9ff2d3eaca92 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.754883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c8d3-3dc4-4ad6-a7bc-a9bccb5b6639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.755787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c8d3-3dc4-4ad6-a7bc-a9bccb5b6639 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.756124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c8d3-3dc4-4ad6-a7bc-a9bccb5b6639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.756438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c8d3-3dc4-4ad6-a7bc-a9bccb5b6639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.757440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c8d3-3dc4-4ad6-a7bc-a9bccb5b6639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.759706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c8d3-3dc4-4ad6-a7bc-a9bccb5b6639 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.789791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1030/2064] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:18 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:18.794124 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388f60e-c08e-421f-b3c6-83a924b7282e service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.804679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388f60e-c08e-421f-b3c6-83a924b7282e service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.866601 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a46e6-a376-4c4d-b973-19a35cc96593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.867476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a46e6-a376-4c4d-b973-19a35cc96593 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.867838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a46e6-a376-4c4d-b973-19a35cc96593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.868190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a46e6-a376-4c4d-b973-19a35cc96593 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.868931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a46e6-a376-4c4d-b973-19a35cc96593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.872195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a46e6-a376-4c4d-b973-19a35cc96593 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.898477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1035/2065] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:18 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:18.902702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c8d3-3dc4-4ad6-a7bc-a9bccb5b6639 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.915273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c8d3-3dc4-4ad6-a7bc-a9bccb5b6639 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.921124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c61d6-0768-4ce7-9726-f766a79e313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.922117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c61d6-0768-4ce7-9726-f766a79e313c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.922428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c61d6-0768-4ce7-9726-f766a79e313c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.922688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c61d6-0768-4ce7-9726-f766a79e313c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.923418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c61d6-0768-4ce7-9726-f766a79e313c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.925332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c61d6-0768-4ce7-9726-f766a79e313c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.940827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1031/2066] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:18.942232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a46e6-a376-4c4d-b973-19a35cc96593 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:18.952965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a46e6-a376-4c4d-b973-19a35cc96593 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:18.958149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:18.958901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:18.959271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:18.959574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] PATH_INFO: `/v3/projects/c868a9f3c9324e7e8340620236c39caa/users/870d7d88c8d3480087d43513c588dd7b/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:18.975253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c868a9f3c9324e7e8340620236c39caa, user_id=870d7d88c8d3480087d43513c588dd7b, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:18.978013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:18.992853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1036/2067] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:18 2022] PUT /identity/v3/projects/c868a9f3c9324e7e8340620236c39caa/users/870d7d88c8d3480087d43513c588dd7b/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:18.996847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c61d6-0768-4ce7-9726-f766a79e313c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.008416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c61d6-0768-4ce7-9726-f766a79e313c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.014391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:19.040222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.043083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:19.079996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:19.091453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bba86-69ca-4aea-91ee-a882bff928d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.092198 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bba86-69ca-4aea-91ee-a882bff928d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.092542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bba86-69ca-4aea-91ee-a882bff928d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.093098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bba86-69ca-4aea-91ee-a882bff928d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.093910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bba86-69ca-4aea-91ee-a882bff928d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.095554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bba86-69ca-4aea-91ee-a882bff928d2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.106969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1032/2068] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:19.111291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bba86-69ca-4aea-91ee-a882bff928d2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.123912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bba86-69ca-4aea-91ee-a882bff928d2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.129172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e95a-7593-4705-b740-94c5c09f6906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.130044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e95a-7593-4705-b740-94c5c09f6906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.130482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e95a-7593-4705-b740-94c5c09f6906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.131016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e95a-7593-4705-b740-94c5c09f6906 admin admin] PATH_INFO: `/v3/projects/c868a9f3c9324e7e8340620236c39caa/users/870d7d88c8d3480087d43513c588dd7b/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.133528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04e95a-7593-4705-b740-94c5c09f6906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c868a9f3c9324e7e8340620236c39caa, user_id=870d7d88c8d3480087d43513c588dd7b, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.136560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04e95a-7593-4705-b740-94c5c09f6906 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.137704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf1b9f-9cbc-4b4e-a5d8-ca5bc5b96d45 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.143153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.143833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.144243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.144527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] PATH_INFO: `/v3/projects/1744660a89e945718645cfa877b689ba` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.145686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1744660a89e945718645cfa877b689ba)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.147614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.150332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1033/2069] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:19 2022] PUT /identity/v3/projects/c868a9f3c9324e7e8340620236c39caa/users/870d7d88c8d3480087d43513c588dd7b/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:19.162241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd14cf-9f24-4765-91ab-c13786db2064 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.163280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd14cf-9f24-4765-91ab-c13786db2064 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.163570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd14cf-9f24-4765-91ab-c13786db2064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.193806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-38fd14cf-9f24-4765-91ab-c13786db2064 None None] MFA Rules not processed for user `870d7d88c8d3480087d43513c588dd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:19.195049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-38fd14cf-9f24-4765-91ab-c13786db2064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:19.202298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1744660a89e945718645cfa877b689ba', 'request_id': 'req-e8f83c9e-267d-44e5-83dd-6582483daed8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:19.210616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1744660a89e945718645cfa877b689ba', 'request_id': 'req-e8f83c9e-267d-44e5-83dd-6582483daed8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:19.216834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1744660a89e945718645cfa877b689ba', 'request_id': 'req-e8f83c9e-267d-44e5-83dd-6582483daed8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:19.229172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] The token cache is being invalidate because project 1744660a89e945718645cfa877b689ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:19.229502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:19.230185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e8f83c9e-267d-44e5-83dd-6582483daed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:19.231875 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1037/2070] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:19 2022] DELETE /identity/v3/projects/1744660a89e945718645cfa877b689ba => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:19.243450 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d1d57-a3e4-4ba7-b814-ef630f2f5a94 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.243900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d1d57-a3e4-4ba7-b814-ef630f2f5a94 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.244309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d1d57-a3e4-4ba7-b814-ef630f2f5a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.266204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d11d1d57-a3e4-4ba7-b814-ef630f2f5a94 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:19.267462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d11d1d57-a3e4-4ba7-b814-ef630f2f5a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:19.269209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1034/2071] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:19.280744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd14cf-9f24-4765-91ab-c13786db2064 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.282138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-38fd14cf-9f24-4765-91ab-c13786db2064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:19.329646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1038/2072] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:19.340829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd14cf-9f24-4765-91ab-c13786db2064 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.342441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b88e-d3c9-4fa6-97a9-ef5b864bbc7c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.342962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b88e-d3c9-4fa6-97a9-ef5b864bbc7c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.343119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b88e-d3c9-4fa6-97a9-ef5b864bbc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.347024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cfcde-ba66-415c-8353-b0fa0036b484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.347698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cfcde-ba66-415c-8353-b0fa0036b484 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.347986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cfcde-ba66-415c-8353-b0fa0036b484 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.348538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cfcde-ba66-415c-8353-b0fa0036b484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.359885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cfcde-ba66-415c-8353-b0fa0036b484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.361252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cfcde-ba66-415c-8353-b0fa0036b484 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.363318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f558b88e-d3c9-4fa6-97a9-ef5b864bbc7c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:19.364525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f558b88e-d3c9-4fa6-97a9-ef5b864bbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:19.370909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1035/2073] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:39:19.372502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1039/2074] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:19.377288 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cfcde-ba66-415c-8353-b0fa0036b484 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.389594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cfcde-ba66-415c-8353-b0fa0036b484 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.399363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.400177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.400850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.401216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.402043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:19.402447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.408370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.424211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1036/2075] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:39:19.429008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b88e-d3c9-4fa6-97a9-ef5b864bbc7c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.445255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b88e-d3c9-4fa6-97a9-ef5b864bbc7c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.450853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55719386-2ba5-4f6e-b19c-7442e288d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.452211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55719386-2ba5-4f6e-b19c-7442e288d052 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.452508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55719386-2ba5-4f6e-b19c-7442e288d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.452804 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55719386-2ba5-4f6e-b19c-7442e288d052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.453582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55719386-2ba5-4f6e-b19c-7442e288d052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.456361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55719386-2ba5-4f6e-b19c-7442e288d052 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.500374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1040/2076] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:19 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:19.505076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.516271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7eee5-f5c9-4bdb-bf85-96c1c9942f78 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.521697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:19.592160 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ebc1-674d-4b95-af2b-f007f8961248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.593083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ebc1-674d-4b95-af2b-f007f8961248 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.593570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ebc1-674d-4b95-af2b-f007f8961248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.593897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ebc1-674d-4b95-af2b-f007f8961248 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.594581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4ebc1-674d-4b95-af2b-f007f8961248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.596683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4ebc1-674d-4b95-af2b-f007f8961248 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.644529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1037/2077] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:19 2022] POST /identity/v3/users => generated 282 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:19.648683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55719386-2ba5-4f6e-b19c-7442e288d052 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.661091 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55719386-2ba5-4f6e-b19c-7442e288d052 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.666222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c526e-78f3-495c-9705-0875dc5a3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.666936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c526e-78f3-495c-9705-0875dc5a3d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.667227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c526e-78f3-495c-9705-0875dc5a3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.667712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c526e-78f3-495c-9705-0875dc5a3d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.668420 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c526e-78f3-495c-9705-0875dc5a3d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.670246 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c526e-78f3-495c-9705-0875dc5a3d9b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.686595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1041/2078] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:39:19.690176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ebc1-674d-4b95-af2b-f007f8961248 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.701612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ebc1-674d-4b95-af2b-f007f8961248 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.712371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c853057-da85-4da8-bbb9-2aafff128c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.713127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853057-da85-4da8-bbb9-2aafff128c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.713127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853057-da85-4da8-bbb9-2aafff128c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.713366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853057-da85-4da8-bbb9-2aafff128c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.714376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c853057-da85-4da8-bbb9-2aafff128c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.717226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c853057-da85-4da8-bbb9-2aafff128c25 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.733443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1038/2079] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:19.734614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c526e-78f3-495c-9705-0875dc5a3d9b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.746932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c526e-78f3-495c-9705-0875dc5a3d9b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.753726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.754411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.754704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.754980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] PATH_INFO: `/v3/projects/3921004ebb9c4f5785f722216423a1d8/users/10248f48507349ef9e6620db44b4ce07/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.757650 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:19.783072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3921004ebb9c4f5785f722216423a1d8, user_id=10248f48507349ef9e6620db44b4ce07, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.785873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.805003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1042/2080] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:19 2022] PUT /identity/v3/projects/3921004ebb9c4f5785f722216423a1d8/users/10248f48507349ef9e6620db44b4ce07/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:19.816560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769873f6-1f97-48e3-b78e-eeb7248dab04 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.816855 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769873f6-1f97-48e3-b78e-eeb7248dab04 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.817137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769873f6-1f97-48e3-b78e-eeb7248dab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.848242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-769873f6-1f97-48e3-b78e-eeb7248dab04 None None] MFA Rules not processed for user `10248f48507349ef9e6620db44b4ce07`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:19.851630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-769873f6-1f97-48e3-b78e-eeb7248dab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:19.885956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.887842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:19.920577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1039/2081] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:19.932210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769873f6-1f97-48e3-b78e-eeb7248dab04 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:19.958621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a9c0c-2750-4b8b-8a6d-ecd03868cb2a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.964528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.965361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.965644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.965922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] PATH_INFO: `/v3/users/71a68dd42aaf47e4a533cbc14a2af176` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:19.967186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a68dd42aaf47e4a533cbc14a2af176)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:19.969451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:19.988453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769873f6-1f97-48e3-b78e-eeb7248dab04 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:19.992170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cead7-7336-4a42-9e4a-5fe056a11b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:19.992793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cead7-7336-4a42-9e4a-5fe056a11b0b service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:19.993072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cead7-7336-4a42-9e4a-5fe056a11b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:19.993348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cead7-7336-4a42-9e4a-5fe056a11b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:20.003961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cead7-7336-4a42-9e4a-5fe056a11b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:20.005437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cead7-7336-4a42-9e4a-5fe056a11b0b service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:20.015042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1040/2082] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:39:20.018123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a68dd42aaf47e4a533cbc14a2af176'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.025587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a68dd42aaf47e4a533cbc14a2af176'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.033221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a68dd42aaf47e4a533cbc14a2af176'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.033893 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a68dd42aaf47e4a533cbc14a2af176'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.046274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a68dd42aaf47e4a533cbc14a2af176'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.052580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1043/2083] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:19 2022] DELETE /identity/v3/users/71a68dd42aaf47e4a533cbc14a2af176 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:20.057026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f309a5-f2c5-4bfb-a54b-6f93f08478f5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:20.057317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f309a5-f2c5-4bfb-a54b-6f93f08478f5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:20.057596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f309a5-f2c5-4bfb-a54b-6f93f08478f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:20.076887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-69f309a5-f2c5-4bfb-a54b-6f93f08478f5 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:20.078106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-69f309a5-f2c5-4bfb-a54b-6f93f08478f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:20.090294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:20.144557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1041/2084] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:39:20.154322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:20.155782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:20.222327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52690b6-f90f-4c8e-9b1d-b7359e2ce6be admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:20.226241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc95db3-06f8-46fb-8ae8-257b97daad4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:20.226978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95db3-06f8-46fb-8ae8-257b97daad4c service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:20.227335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95db3-06f8-46fb-8ae8-257b97daad4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:20.227856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95db3-06f8-46fb-8ae8-257b97daad4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:20.241913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc95db3-06f8-46fb-8ae8-257b97daad4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:20.243726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc95db3-06f8-46fb-8ae8-257b97daad4c service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:20.257099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1044/2085] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:20.565110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f309a5-f2c5-4bfb-a54b-6f93f08478f5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:20.566556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-69f309a5-f2c5-4bfb-a54b-6f93f08478f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:20.581753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f309a5-f2c5-4bfb-a54b-6f93f08478f5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:20.586436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:20.587089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:20.587390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:20.587676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] PATH_INFO: `/v3/projects/821c72d13aaf4f8d8699e19e713f617a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:20.588837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=821c72d13aaf4f8d8699e19e713f617a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:20.590761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:20.639346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821c72d13aaf4f8d8699e19e713f617a', 'request_id': 'req-f41d4481-e213-46d4-bb2b-f916cc3effe1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.646323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821c72d13aaf4f8d8699e19e713f617a', 'request_id': 'req-f41d4481-e213-46d4-bb2b-f916cc3effe1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.652049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821c72d13aaf4f8d8699e19e713f617a', 'request_id': 'req-f41d4481-e213-46d4-bb2b-f916cc3effe1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.668581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] The token cache is being invalidate because project 821c72d13aaf4f8d8699e19e713f617a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:20.668797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.670016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.671582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1042/2086] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:20 2022] DELETE /identity/v3/projects/821c72d13aaf4f8d8699e19e713f617a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:20.676164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc95db3-06f8-46fb-8ae8-257b97daad4c service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:20.682282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:20.686340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc95db3-06f8-46fb-8ae8-257b97daad4c service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:20.750557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:20.751725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:20.752241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:20.752754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] PATH_INFO: `/v3/users/870d7d88c8d3480087d43513c588dd7b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:20.754793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870d7d88c8d3480087d43513c588dd7b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:20.758117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:20.808433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870d7d88c8d3480087d43513c588dd7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.816179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870d7d88c8d3480087d43513c588dd7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.823961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870d7d88c8d3480087d43513c588dd7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.824695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870d7d88c8d3480087d43513c588dd7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.840274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-41fdced3-55a8-42a8-a31a-952b417efe57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870d7d88c8d3480087d43513c588dd7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:20.849057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1045/2087] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:20 2022] DELETE /identity/v3/users/870d7d88c8d3480087d43513c588dd7b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:21.212682 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:21.214221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:21.228165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4481-e213-46d4-bb2b-f916cc3effe1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:21.297647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:21.298312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.298596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.298870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] PATH_INFO: `/v3/projects/c868a9f3c9324e7e8340620236c39caa` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.300713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c868a9f3c9324e7e8340620236c39caa)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:21.302755 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:21.348293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:21.352743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c868a9f3c9324e7e8340620236c39caa', 'request_id': 'req-8becb223-2796-40c0-84b9-2ddae16a91c6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:21.360544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c868a9f3c9324e7e8340620236c39caa', 'request_id': 'req-8becb223-2796-40c0-84b9-2ddae16a91c6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:21.366304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c868a9f3c9324e7e8340620236c39caa', 'request_id': 'req-8becb223-2796-40c0-84b9-2ddae16a91c6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:21.380906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] The token cache is being invalidate because project c868a9f3c9324e7e8340620236c39caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:21.381201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:21.381885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8becb223-2796-40c0-84b9-2ddae16a91c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:21.383834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1043/2088] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:21 2022] DELETE /identity/v3/projects/c868a9f3c9324e7e8340620236c39caa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:21.389197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3e58-1e4b-4319-99c4-c8b19d0cba0d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.389545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3e58-1e4b-4319-99c4-c8b19d0cba0d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.389902 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3e58-1e4b-4319-99c4-c8b19d0cba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.413552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-abef3e58-1e4b-4319-99c4-c8b19d0cba0d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:21.415361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-abef3e58-1e4b-4319-99c4-c8b19d0cba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:21.485057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1046/2089] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:21.492960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b400a3-0771-401a-b456-9881415e97b2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.493252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b400a3-0771-401a-b456-9881415e97b2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.493660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b400a3-0771-401a-b456-9881415e97b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.515839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-31b400a3-0771-401a-b456-9881415e97b2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:21.517073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-31b400a3-0771-401a-b456-9881415e97b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:21.526821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1044/2090] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:21.536989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3e58-1e4b-4319-99c4-c8b19d0cba0d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:21.549413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3e58-1e4b-4319-99c4-c8b19d0cba0d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:21.554017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:21.555028 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.555311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.557428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.558160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:21.558536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:21.560863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:21.579351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1047/2091] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:21.580167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b400a3-0771-401a-b456-9881415e97b2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:21.590829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b400a3-0771-401a-b456-9881415e97b2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:21.596179 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3790-891c-4174-b081-20b185a4e293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:21.596962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3790-891c-4174-b081-20b185a4e293 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.597294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3790-891c-4174-b081-20b185a4e293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.597671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3790-891c-4174-b081-20b185a4e293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.598525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b3790-891c-4174-b081-20b185a4e293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:21.600749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b3790-891c-4174-b081-20b185a4e293 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:21.630887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1045/2092] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:21 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:21.635319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:21.645636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92dd5-040b-4492-afc1-a823cb169e65 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:21.654210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:21.714596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3ef9b-b448-4e58-8f30-362423b4d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:21.715197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ef9b-b448-4e58-8f30-362423b4d13a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.715477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ef9b-b448-4e58-8f30-362423b4d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.715737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3ef9b-b448-4e58-8f30-362423b4d13a admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.716439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3ef9b-b448-4e58-8f30-362423b4d13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:21.718331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3ef9b-b448-4e58-8f30-362423b4d13a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:21.741499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1048/2093] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:21 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:21.745785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3790-891c-4174-b081-20b185a4e293 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:21.758657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3790-891c-4174-b081-20b185a4e293 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:21.763495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764b22-9f75-4289-bd28-2c3cbb7f1a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:21.764115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764b22-9f75-4289-bd28-2c3cbb7f1a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.764400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764b22-9f75-4289-bd28-2c3cbb7f1a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.764680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764b22-9f75-4289-bd28-2c3cbb7f1a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.765375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764b22-9f75-4289-bd28-2c3cbb7f1a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:21.766990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764b22-9f75-4289-bd28-2c3cbb7f1a77 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:21.777158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1046/2094] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:21.781554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3ef9b-b448-4e58-8f30-362423b4d13a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:21.791430 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3ef9b-b448-4e58-8f30-362423b4d13a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:21.797454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead597d6-c8d8-478c-bac7-0920230a691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:21.798070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead597d6-c8d8-478c-bac7-0920230a691f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.798419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead597d6-c8d8-478c-bac7-0920230a691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.798784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead597d6-c8d8-478c-bac7-0920230a691f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.799300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead597d6-c8d8-478c-bac7-0920230a691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:21.801289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead597d6-c8d8-478c-bac7-0920230a691f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:21.814253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1049/2095] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:21.818695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764b22-9f75-4289-bd28-2c3cbb7f1a77 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:21.829505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764b22-9f75-4289-bd28-2c3cbb7f1a77 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:21.834959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a25892-8a60-4225-ac92-7da1cd20e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:21.835668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a25892-8a60-4225-ac92-7da1cd20e57f admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.835955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a25892-8a60-4225-ac92-7da1cd20e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.836234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a25892-8a60-4225-ac92-7da1cd20e57f admin admin] PATH_INFO: `/v3/projects/b0fbbbb1f49046c8b59510f9b559b60e/users/4398ab3fe1364036af626aa876bbb408/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.852481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a25892-8a60-4225-ac92-7da1cd20e57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0fbbbb1f49046c8b59510f9b559b60e, user_id=4398ab3fe1364036af626aa876bbb408, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:21.855162 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a25892-8a60-4225-ac92-7da1cd20e57f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:21.870120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1047/2096] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:21 2022] PUT /identity/v3/projects/b0fbbbb1f49046c8b59510f9b559b60e/users/4398ab3fe1364036af626aa876bbb408/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:21.882908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d42e-d717-4e07-a291-2a9721797f2d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:21.883207 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d42e-d717-4e07-a291-2a9721797f2d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:21.883527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d42e-d717-4e07-a291-2a9721797f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:21.915848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d634d42e-d717-4e07-a291-2a9721797f2d None None] MFA Rules not processed for user `4398ab3fe1364036af626aa876bbb408`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:21.917219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d634d42e-d717-4e07-a291-2a9721797f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:21.989913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1050/2097] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:21.994226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a25892-8a60-4225-ac92-7da1cd20e57f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:22.068278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a25892-8a60-4225-ac92-7da1cd20e57f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:22.074269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2ff1-8bb7-4407-872e-c526656d5932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:22.074892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2ff1-8bb7-4407-872e-c526656d5932 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:22.075174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2ff1-8bb7-4407-872e-c526656d5932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:22.075486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2ff1-8bb7-4407-872e-c526656d5932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:22.076278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2ff1-8bb7-4407-872e-c526656d5932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:22.078256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2ff1-8bb7-4407-872e-c526656d5932 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:22.109460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1048/2098] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:21 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:22.112715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634d42e-d717-4e07-a291-2a9721797f2d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:22.123771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634d42e-d717-4e07-a291-2a9721797f2d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:22.182715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617baf2-6c2f-4a41-b653-4a70b1324c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:22.183353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617baf2-6c2f-4a41-b653-4a70b1324c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:22.183658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617baf2-6c2f-4a41-b653-4a70b1324c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:22.183952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617baf2-6c2f-4a41-b653-4a70b1324c10 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:22.184615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617baf2-6c2f-4a41-b653-4a70b1324c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:22.186598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617baf2-6c2f-4a41-b653-4a70b1324c10 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:22.213302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1051/2099] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:22 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:22.214514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2ff1-8bb7-4407-872e-c526656d5932 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:22.225464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2ff1-8bb7-4407-872e-c526656d5932 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:22.230107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02478c0-6835-4a91-99b7-0951d16a8865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:22.230711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02478c0-6835-4a91-99b7-0951d16a8865 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:22.230996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02478c0-6835-4a91-99b7-0951d16a8865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:22.231277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02478c0-6835-4a91-99b7-0951d16a8865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:22.232655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02478c0-6835-4a91-99b7-0951d16a8865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:22.234300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02478c0-6835-4a91-99b7-0951d16a8865 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:22.246405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1049/2100] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:22.250985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617baf2-6c2f-4a41-b653-4a70b1324c10 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:22.261123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617baf2-6c2f-4a41-b653-4a70b1324c10 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:22.266294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818af1c7-3b8c-436f-80d4-be96e0cecd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:22.266953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818af1c7-3b8c-436f-80d4-be96e0cecd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:22.267237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818af1c7-3b8c-436f-80d4-be96e0cecd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:22.267550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818af1c7-3b8c-436f-80d4-be96e0cecd77 admin admin] PATH_INFO: `/v3/projects/9b6baa55e6874103b036d4a1eb619656/users/e380cae3628d4a5280afb35d76ad01d4/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:22.270707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:22.285792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818af1c7-3b8c-436f-80d4-be96e0cecd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6baa55e6874103b036d4a1eb619656, user_id=e380cae3628d4a5280afb35d76ad01d4, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:22.288486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818af1c7-3b8c-436f-80d4-be96e0cecd77 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:22.301563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1052/2101] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:22 2022] PUT /identity/v3/projects/9b6baa55e6874103b036d4a1eb619656/users/e380cae3628d4a5280afb35d76ad01d4/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:22.305704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02478c0-6835-4a91-99b7-0951d16a8865 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:22.315863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02478c0-6835-4a91-99b7-0951d16a8865 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:22.357326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:22.374942 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55683158-a87d-4a85-b2b1-2ace33994b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:22.375595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683158-a87d-4a85-b2b1-2ace33994b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:22.375882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683158-a87d-4a85-b2b1-2ace33994b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:22.376157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683158-a87d-4a85-b2b1-2ace33994b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:22.376848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55683158-a87d-4a85-b2b1-2ace33994b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:22.378456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55683158-a87d-4a85-b2b1-2ace33994b41 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:22.388787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1050/2102] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:22.393032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818af1c7-3b8c-436f-80d4-be96e0cecd77 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:22.403198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818af1c7-3b8c-436f-80d4-be96e0cecd77 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:22.408428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:22.409106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:22.409361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:22.409630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] PATH_INFO: `/v3/projects/9b6baa55e6874103b036d4a1eb619656/users/e380cae3628d4a5280afb35d76ad01d4/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:22.411563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6baa55e6874103b036d4a1eb619656, user_id=e380cae3628d4a5280afb35d76ad01d4, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:22.414166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:22.424109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1053/2103] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:22 2022] PUT /identity/v3/projects/9b6baa55e6874103b036d4a1eb619656/users/e380cae3628d4a5280afb35d76ad01d4/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:22.434454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234289-451e-49ba-a990-4f70e21c725b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:22.434746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234289-451e-49ba-a990-4f70e21c725b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:22.435056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234289-451e-49ba-a990-4f70e21c725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:22.463210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c3234289-451e-49ba-a990-4f70e21c725b None None] MFA Rules not processed for user `e380cae3628d4a5280afb35d76ad01d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:22.464564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c3234289-451e-49ba-a990-4f70e21c725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:22.532627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1051/2104] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:22.547568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:22.549315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:22.615581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cc9c8-9869-439b-963a-d7faa17d6355 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:22.619340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ef66d-b0e5-491c-8cf3-df9a727f1e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:22.619993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef66d-b0e5-491c-8cf3-df9a727f1e45 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:22.620277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef66d-b0e5-491c-8cf3-df9a727f1e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:22.620554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef66d-b0e5-491c-8cf3-df9a727f1e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:22.682121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ef66d-b0e5-491c-8cf3-df9a727f1e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:22.683635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ef66d-b0e5-491c-8cf3-df9a727f1e45 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:22.693840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1054/2105] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:25.362363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3234289-451e-49ba-a990-4f70e21c725b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:25.363993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c3234289-451e-49ba-a990-4f70e21c725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:25.376819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3234289-451e-49ba-a990-4f70e21c725b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:25.381119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d003d-57bd-489e-b22a-39c27ecc2bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:25.381767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d003d-57bd-489e-b22a-39c27ecc2bbb service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:25.382096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d003d-57bd-489e-b22a-39c27ecc2bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:25.382315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d003d-57bd-489e-b22a-39c27ecc2bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:25.392835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d003d-57bd-489e-b22a-39c27ecc2bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:25.394299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d003d-57bd-489e-b22a-39c27ecc2bbb service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:25.404831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1052/2106] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:28.563591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77b8f-c1a7-4fd2-aad2-6ae043a82692 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:28.564131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77b8f-c1a7-4fd2-aad2-6ae043a82692 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:28.564131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77b8f-c1a7-4fd2-aad2-6ae043a82692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:28.583475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-50b77b8f-c1a7-4fd2-aad2-6ae043a82692 None None] MFA Rules not processed for user `55e12a10e720431d8fa1f3331c468bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:28.584678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-50b77b8f-c1a7-4fd2-aad2-6ae043a82692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:28.641587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1055/2107] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:35.400046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=50 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:38.634159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:40.330660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d003d-57bd-489e-b22a-39c27ecc2bbb service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:40.402011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d003d-57bd-489e-b22a-39c27ecc2bbb service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:40.407274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:40.408000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:40.408287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:40.408569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] PATH_INFO: `/v3/users/4398ab3fe1364036af626aa876bbb408` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:40.409769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4398ab3fe1364036af626aa876bbb408)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:40.411758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:40.461626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4398ab3fe1364036af626aa876bbb408'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:40.469071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4398ab3fe1364036af626aa876bbb408'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:40.469777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4398ab3fe1364036af626aa876bbb408'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:40.484244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4398ab3fe1364036af626aa876bbb408'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:40.485134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4398ab3fe1364036af626aa876bbb408'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:40.499246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1053/2108] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:40 2022] DELETE /identity/v3/users/4398ab3fe1364036af626aa876bbb408 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:40.503806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788514b7-3e63-4d79-912c-e23d933d6568 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:40.504289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788514b7-3e63-4d79-912c-e23d933d6568 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:40.504402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788514b7-3e63-4d79-912c-e23d933d6568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:40.524030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-788514b7-3e63-4d79-912c-e23d933d6568 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:40.525262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-788514b7-3e63-4d79-912c-e23d933d6568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:40.591031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1056/2109] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:40.601481 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:40.602803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:40.679855 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec543-bae5-488a-a443-b091c64de85d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:40.683641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6396fc-75f9-49fa-ae8f-8541eaa45e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:40.684267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6396fc-75f9-49fa-ae8f-8541eaa45e3d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:40.684546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6396fc-75f9-49fa-ae8f-8541eaa45e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:40.684822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6396fc-75f9-49fa-ae8f-8541eaa45e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:40.705920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6396fc-75f9-49fa-ae8f-8541eaa45e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:40.707420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6396fc-75f9-49fa-ae8f-8541eaa45e3d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:40.722886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1054/2110] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:41.131140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788514b7-3e63-4d79-912c-e23d933d6568 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:41.132833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-788514b7-3e63-4d79-912c-e23d933d6568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:41.145366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788514b7-3e63-4d79-912c-e23d933d6568 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:41.150611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:41.151262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:41.151565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:41.151837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] PATH_INFO: `/v3/projects/b0fbbbb1f49046c8b59510f9b559b60e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:41.153112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0fbbbb1f49046c8b59510f9b559b60e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:41.156242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:41.221591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0fbbbb1f49046c8b59510f9b559b60e', 'request_id': 'req-ea21ed8a-8818-4082-af2f-51196430cfd6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.229779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0fbbbb1f49046c8b59510f9b559b60e', 'request_id': 'req-ea21ed8a-8818-4082-af2f-51196430cfd6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.241920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0fbbbb1f49046c8b59510f9b559b60e', 'request_id': 'req-ea21ed8a-8818-4082-af2f-51196430cfd6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.254858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] The token cache is being invalidate because project b0fbbbb1f49046c8b59510f9b559b60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:41.255149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.255832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.257378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1057/2111] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:41 2022] DELETE /identity/v3/projects/b0fbbbb1f49046c8b59510f9b559b60e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:41.261330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6396fc-75f9-49fa-ae8f-8541eaa45e3d service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:41.275321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6396fc-75f9-49fa-ae8f-8541eaa45e3d service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:41.295004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:41.345599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:41.346363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:41.346537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:41.346815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] PATH_INFO: `/v3/users/e380cae3628d4a5280afb35d76ad01d4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:41.348041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e380cae3628d4a5280afb35d76ad01d4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:41.349989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:41.399174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e380cae3628d4a5280afb35d76ad01d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.407808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e380cae3628d4a5280afb35d76ad01d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.408462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e380cae3628d4a5280afb35d76ad01d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.422637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e380cae3628d4a5280afb35d76ad01d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.423487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b92a51c9-32b0-416c-85b5-9609b347ff3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e380cae3628d4a5280afb35d76ad01d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.437376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1055/2112] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:41 2022] DELETE /identity/v3/users/e380cae3628d4a5280afb35d76ad01d4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:41.723710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:41.725528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:41.740152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21ed8a-8818-4082-af2f-51196430cfd6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:41.807071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:41.807789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:41.808068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:41.808386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] PATH_INFO: `/v3/projects/9b6baa55e6874103b036d4a1eb619656` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:41.810520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6baa55e6874103b036d4a1eb619656)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:41.812810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:41.845041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:41.865938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6baa55e6874103b036d4a1eb619656', 'request_id': 'req-1bc91546-7412-4853-8431-dbb7452715aa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.876541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6baa55e6874103b036d4a1eb619656', 'request_id': 'req-1bc91546-7412-4853-8431-dbb7452715aa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.882899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6baa55e6874103b036d4a1eb619656', 'request_id': 'req-1bc91546-7412-4853-8431-dbb7452715aa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.895585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] The token cache is being invalidate because project 9b6baa55e6874103b036d4a1eb619656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:41.895914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.900164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1bc91546-7412-4853-8431-dbb7452715aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:41.902219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1058/2113] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:41 2022] DELETE /identity/v3/projects/9b6baa55e6874103b036d4a1eb619656 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:41.907407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a19c-6ea9-48f2-907c-d7c3b082cdc0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:41.907725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a19c-6ea9-48f2-907c-d7c3b082cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:41.908042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a19c-6ea9-48f2-907c-d7c3b082cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:41.930132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-afa1a19c-6ea9-48f2-907c-d7c3b082cdc0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:41.931366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-afa1a19c-6ea9-48f2-907c-d7c3b082cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:42.003920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1056/2114] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:42.012574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd4ee-ede8-4283-b0fc-f0681cfa9159 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.012897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd4ee-ede8-4283-b0fc-f0681cfa9159 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.013170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd4ee-ede8-4283-b0fc-f0681cfa9159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.034154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8a8fd4ee-ede8-4283-b0fc-f0681cfa9159 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:42.035394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8a8fd4ee-ede8-4283-b0fc-f0681cfa9159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:42.044538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1059/2115] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:42.049637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1a19c-6ea9-48f2-907c-d7c3b082cdc0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.060965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1a19c-6ea9-48f2-907c-d7c3b082cdc0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.066708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.067514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.067865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.068209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.069044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:42.069507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.071279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.086716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1057/2116] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:42.091269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd4ee-ede8-4283-b0fc-f0681cfa9159 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.102333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd4ee-ede8-4283-b0fc-f0681cfa9159 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.112429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c2baf-b21e-465e-ad96-01542901b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.113324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c2baf-b21e-465e-ad96-01542901b110 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.113628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c2baf-b21e-465e-ad96-01542901b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.114686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c2baf-b21e-465e-ad96-01542901b110 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.114880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c2baf-b21e-465e-ad96-01542901b110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.117189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c2baf-b21e-465e-ad96-01542901b110 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.156604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1060/2117] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:42 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:42.161585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.174306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00c71-cf7c-4499-8180-10622086c6ce admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.208225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:42.252273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4171b5c-42ed-4bc2-a721-2bfca0d81345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.252912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4171b5c-42ed-4bc2-a721-2bfca0d81345 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.253197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4171b5c-42ed-4bc2-a721-2bfca0d81345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.253475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4171b5c-42ed-4bc2-a721-2bfca0d81345 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.254159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4171b5c-42ed-4bc2-a721-2bfca0d81345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.256565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4171b5c-42ed-4bc2-a721-2bfca0d81345 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.280767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1058/2118] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:42 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:42.285109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c2baf-b21e-465e-ad96-01542901b110 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.297399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c2baf-b21e-465e-ad96-01542901b110 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.304080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32d0cb-356e-41b4-8b24-6f75b8bbbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.304735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32d0cb-356e-41b4-8b24-6f75b8bbbf35 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.305019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32d0cb-356e-41b4-8b24-6f75b8bbbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.305296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32d0cb-356e-41b4-8b24-6f75b8bbbf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.306260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32d0cb-356e-41b4-8b24-6f75b8bbbf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.307945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32d0cb-356e-41b4-8b24-6f75b8bbbf35 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.324837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1061/2119] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:42.329655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4171b5c-42ed-4bc2-a721-2bfca0d81345 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.343125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4171b5c-42ed-4bc2-a721-2bfca0d81345 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.348116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f44d39-bfda-4021-a2fe-67b2829000aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.348856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f44d39-bfda-4021-a2fe-67b2829000aa admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.349014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f44d39-bfda-4021-a2fe-67b2829000aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.349274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f44d39-bfda-4021-a2fe-67b2829000aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.349977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f44d39-bfda-4021-a2fe-67b2829000aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.351642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f44d39-bfda-4021-a2fe-67b2829000aa admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.371778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1059/2120] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:42.376813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32d0cb-356e-41b4-8b24-6f75b8bbbf35 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.389438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32d0cb-356e-41b4-8b24-6f75b8bbbf35 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.395584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164eec7-b6d3-4207-9306-929af94a8ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.396270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164eec7-b6d3-4207-9306-929af94a8ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.396551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164eec7-b6d3-4207-9306-929af94a8ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.396859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164eec7-b6d3-4207-9306-929af94a8ff5 admin admin] PATH_INFO: `/v3/projects/7531351338c64cc7945b2ccd792d4397/users/c06c598dfed34a0ea6ac0209c4ec828a/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.425606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164eec7-b6d3-4207-9306-929af94a8ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7531351338c64cc7945b2ccd792d4397, user_id=c06c598dfed34a0ea6ac0209c4ec828a, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.428776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164eec7-b6d3-4207-9306-929af94a8ff5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.458735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1062/2121] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:42 2022] PUT /identity/v3/projects/7531351338c64cc7945b2ccd792d4397/users/c06c598dfed34a0ea6ac0209c4ec828a/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:42.465243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe086d-dfe2-4f21-bfb4-2ef23c369853 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.465536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe086d-dfe2-4f21-bfb4-2ef23c369853 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.466935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe086d-dfe2-4f21-bfb4-2ef23c369853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.500918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8bfe086d-dfe2-4f21-bfb4-2ef23c369853 None None] MFA Rules not processed for user `c06c598dfed34a0ea6ac0209c4ec828a`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:42.502158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8bfe086d-dfe2-4f21-bfb4-2ef23c369853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:42.575777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1060/2122] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:42.580558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164eec7-b6d3-4207-9306-929af94a8ff5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.649772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164eec7-b6d3-4207-9306-929af94a8ff5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.655709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ebbc5-2e7d-4531-b9a2-dce9461644b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.656351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ebbc5-2e7d-4531-b9a2-dce9461644b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.656773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ebbc5-2e7d-4531-b9a2-dce9461644b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.657246 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ebbc5-2e7d-4531-b9a2-dce9461644b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.660331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ebbc5-2e7d-4531-b9a2-dce9461644b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.662297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ebbc5-2e7d-4531-b9a2-dce9461644b6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.691122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1063/2123] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:42 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:42.696138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe086d-dfe2-4f21-bfb4-2ef23c369853 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.708516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe086d-dfe2-4f21-bfb4-2ef23c369853 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.770475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b48d9-f8f3-49bf-ac8f-3cf3f32f00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.771200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b48d9-f8f3-49bf-ac8f-3cf3f32f00e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.771514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b48d9-f8f3-49bf-ac8f-3cf3f32f00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.771813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b48d9-f8f3-49bf-ac8f-3cf3f32f00e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.772488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b48d9-f8f3-49bf-ac8f-3cf3f32f00e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.774476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b48d9-f8f3-49bf-ac8f-3cf3f32f00e4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.797294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1061/2124] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:42 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:42.802047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ebbc5-2e7d-4531-b9a2-dce9461644b6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.814033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ebbc5-2e7d-4531-b9a2-dce9461644b6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.819044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0408ff-969f-4b48-9622-1043ab689562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.819711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0408ff-969f-4b48-9622-1043ab689562 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.819990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0408ff-969f-4b48-9622-1043ab689562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.820262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0408ff-969f-4b48-9622-1043ab689562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.820990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0408ff-969f-4b48-9622-1043ab689562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.822627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0408ff-969f-4b48-9622-1043ab689562 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.835325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1064/2125] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:42.840486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b48d9-f8f3-49bf-ac8f-3cf3f32f00e4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.856723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b48d9-f8f3-49bf-ac8f-3cf3f32f00e4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.862357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98d7e-0050-4500-ad98-a302fb5b5b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.863030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98d7e-0050-4500-ad98-a302fb5b5b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.863317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98d7e-0050-4500-ad98-a302fb5b5b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.863627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98d7e-0050-4500-ad98-a302fb5b5b79 admin admin] PATH_INFO: `/v3/projects/e609effa63db405f9e539d95295abafb/users/c40afe15a9784f0aab299591e3cdf2a2/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.880829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98d7e-0050-4500-ad98-a302fb5b5b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e609effa63db405f9e539d95295abafb, user_id=c40afe15a9784f0aab299591e3cdf2a2, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.883637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98d7e-0050-4500-ad98-a302fb5b5b79 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.897246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1062/2126] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:42 2022] PUT /identity/v3/projects/e609effa63db405f9e539d95295abafb/users/c40afe15a9784f0aab299591e3cdf2a2/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:42.901965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0408ff-969f-4b48-9622-1043ab689562 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:42.913722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0408ff-969f-4b48-9622-1043ab689562 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:42.937271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:42.982974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bd8c1-0c23-49f3-99ce-c9e6abd862fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:42.983557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd8c1-0c23-49f3-99ce-c9e6abd862fd admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:42.984038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd8c1-0c23-49f3-99ce-c9e6abd862fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:42.984319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd8c1-0c23-49f3-99ce-c9e6abd862fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:42.985025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bd8c1-0c23-49f3-99ce-c9e6abd862fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:42.986742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bd8c1-0c23-49f3-99ce-c9e6abd862fd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:42.997788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1065/2127] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:39:43.002258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98d7e-0050-4500-ad98-a302fb5b5b79 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:43.008041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:43.015468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98d7e-0050-4500-ad98-a302fb5b5b79 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:43.023333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:43.024061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:43.024342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:43.024625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] PATH_INFO: `/v3/projects/e609effa63db405f9e539d95295abafb/users/c40afe15a9784f0aab299591e3cdf2a2/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:43.026619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e609effa63db405f9e539d95295abafb, user_id=c40afe15a9784f0aab299591e3cdf2a2, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:43.029315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:43.040182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1063/2128] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:43 2022] PUT /identity/v3/projects/e609effa63db405f9e539d95295abafb/users/c40afe15a9784f0aab299591e3cdf2a2/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:43.051088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1af4-0a91-49a2-9d1a-a6036a85a6fb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:43.051459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1af4-0a91-49a2-9d1a-a6036a85a6fb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:43.051914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1af4-0a91-49a2-9d1a-a6036a85a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:43.082460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-320c1af4-0a91-49a2-9d1a-a6036a85a6fb None None] MFA Rules not processed for user `c40afe15a9784f0aab299591e3cdf2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:43.083695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-320c1af4-0a91-49a2-9d1a-a6036a85a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:43.156519 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1066/2129] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:43.168634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:43.171008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:43.232958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a4896-560c-4c34-a9b0-39f0ef2ab459 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:43.238184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e65f88-4448-4357-9e22-19fab8da6e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:43.238600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e65f88-4448-4357-9e22-19fab8da6e4a service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:43.238988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e65f88-4448-4357-9e22-19fab8da6e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:43.239333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e65f88-4448-4357-9e22-19fab8da6e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:43.257138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e65f88-4448-4357-9e22-19fab8da6e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:43.258626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e65f88-4448-4357-9e22-19fab8da6e4a service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:43.269465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1064/2130] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:43.314881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1af4-0a91-49a2-9d1a-a6036a85a6fb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:43.316360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-320c1af4-0a91-49a2-9d1a-a6036a85a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:43.330576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1af4-0a91-49a2-9d1a-a6036a85a6fb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:43.334327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f497f59-872b-41dd-823e-c720d13ad450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:43.334945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f497f59-872b-41dd-823e-c720d13ad450 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:43.335226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f497f59-872b-41dd-823e-c720d13ad450 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:43.335529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f497f59-872b-41dd-823e-c720d13ad450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:43.400264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f497f59-872b-41dd-823e-c720d13ad450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:43.401712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f497f59-872b-41dd-823e-c720d13ad450 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:43.410849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1067/2131] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:39:46.913315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e65f88-4448-4357-9e22-19fab8da6e4a service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:46.984406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e65f88-4448-4357-9e22-19fab8da6e4a service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:46.989597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:46.990255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:46.990534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:46.990897 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] PATH_INFO: `/v3/users/c06c598dfed34a0ea6ac0209c4ec828a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:46.992199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06c598dfed34a0ea6ac0209c4ec828a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:46.994200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:47.058338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06c598dfed34a0ea6ac0209c4ec828a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.068324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06c598dfed34a0ea6ac0209c4ec828a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.069051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06c598dfed34a0ea6ac0209c4ec828a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.084829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06c598dfed34a0ea6ac0209c4ec828a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.085966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06c598dfed34a0ea6ac0209c4ec828a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.100673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1065/2132] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:46 2022] DELETE /identity/v3/users/c06c598dfed34a0ea6ac0209c4ec828a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:47.105331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cbf4d-69fa-4f61-b7b7-cd57f3fc5410 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:47.105794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cbf4d-69fa-4f61-b7b7-cd57f3fc5410 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:47.105873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cbf4d-69fa-4f61-b7b7-cd57f3fc5410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:47.128262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c55cbf4d-69fa-4f61-b7b7-cd57f3fc5410 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:47.129485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c55cbf4d-69fa-4f61-b7b7-cd57f3fc5410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:47.188320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:47.209744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1068/2133] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:47.219872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:47.221203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:47.240545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:47.292223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584c132-b7ea-4863-9e06-f4a570d919f1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:47.295939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f4921-8392-46be-9049-5e3589a98892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:47.296559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f4921-8392-46be-9049-5e3589a98892 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:47.296835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f4921-8392-46be-9049-5e3589a98892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:47.297264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f4921-8392-46be-9049-5e3589a98892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:47.306967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f4921-8392-46be-9049-5e3589a98892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:47.308491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f4921-8392-46be-9049-5e3589a98892 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:47.318459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1066/2134] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:39:47.607210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cbf4d-69fa-4f61-b7b7-cd57f3fc5410 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:47.608667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c55cbf4d-69fa-4f61-b7b7-cd57f3fc5410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:47.627428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cbf4d-69fa-4f61-b7b7-cd57f3fc5410 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:47.632525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:47.633044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:47.633329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:47.633604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] PATH_INFO: `/v3/projects/7531351338c64cc7945b2ccd792d4397` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:47.634773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7531351338c64cc7945b2ccd792d4397)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:47.636829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:47.683709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7531351338c64cc7945b2ccd792d4397', 'request_id': 'req-8961aca5-b8fb-488c-a273-513ae3cf5264'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.691942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7531351338c64cc7945b2ccd792d4397', 'request_id': 'req-8961aca5-b8fb-488c-a273-513ae3cf5264'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.697741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7531351338c64cc7945b2ccd792d4397', 'request_id': 'req-8961aca5-b8fb-488c-a273-513ae3cf5264'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.709754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] The token cache is being invalidate because project 7531351338c64cc7945b2ccd792d4397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:47.710064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.710690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.712236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1069/2135] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:47 2022] DELETE /identity/v3/projects/7531351338c64cc7945b2ccd792d4397 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:47.716767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f4921-8392-46be-9049-5e3589a98892 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:47.730147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f4921-8392-46be-9049-5e3589a98892 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:47.787792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:47.788487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:47.788780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:47.789062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] PATH_INFO: `/v3/users/c40afe15a9784f0aab299591e3cdf2a2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:47.790274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40afe15a9784f0aab299591e3cdf2a2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:47.792253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:47.838844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40afe15a9784f0aab299591e3cdf2a2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.845985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40afe15a9784f0aab299591e3cdf2a2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.846619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40afe15a9784f0aab299591e3cdf2a2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.859579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40afe15a9784f0aab299591e3cdf2a2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.860248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6880a81b-e887-45af-bacc-efb1df336eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40afe15a9784f0aab299591e3cdf2a2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:47.874147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1067/2136] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:39:47 2022] DELETE /identity/v3/users/c40afe15a9784f0aab299591e3cdf2a2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:39:48.156321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.158167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:48.176576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961aca5-b8fb-488c-a273-513ae3cf5264 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.250300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.250928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.251198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.251521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] PATH_INFO: `/v3/projects/e609effa63db405f9e539d95295abafb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.252705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e609effa63db405f9e539d95295abafb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.254613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.305418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e609effa63db405f9e539d95295abafb', 'request_id': 'req-ba18d03d-e501-4bb4-b74b-317a34c37b4d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:48.315165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e609effa63db405f9e539d95295abafb', 'request_id': 'req-ba18d03d-e501-4bb4-b74b-317a34c37b4d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:48.325336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e609effa63db405f9e539d95295abafb', 'request_id': 'req-ba18d03d-e501-4bb4-b74b-317a34c37b4d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:48.336881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:48.343920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] The token cache is being invalidate because project e609effa63db405f9e539d95295abafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:39:48.344297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:48.345633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ba18d03d-e501-4bb4-b74b-317a34c37b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:39:48.347920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1070/2137] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:39:48 2022] DELETE /identity/v3/projects/e609effa63db405f9e539d95295abafb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:48.354606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f5e69-98e0-430d-bf5d-8e1361e24e1f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.355467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f5e69-98e0-430d-bf5d-8e1361e24e1f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.355467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f5e69-98e0-430d-bf5d-8e1361e24e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.383443 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-393f5e69-98e0-430d-bf5d-8e1361e24e1f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:48.385039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-393f5e69-98e0-430d-bf5d-8e1361e24e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:48.428412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:48.488254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1068/2138] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:48.497427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f4d6-9e79-46c1-8f29-3e4222001fc8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.497917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f4d6-9e79-46c1-8f29-3e4222001fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.498366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f4d6-9e79-46c1-8f29-3e4222001fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.524899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6de4f4d6-9e79-46c1-8f29-3e4222001fc8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:48.526168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6de4f4d6-9e79-46c1-8f29-3e4222001fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:48.535209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1071/2139] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:48.539494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f5e69-98e0-430d-bf5d-8e1361e24e1f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.549467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f5e69-98e0-430d-bf5d-8e1361e24e1f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.554442 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.555014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.555293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.555602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.556306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:48.556613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.558243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.571129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1069/2140] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:48.576465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4f4d6-9e79-46c1-8f29-3e4222001fc8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.587532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4f4d6-9e79-46c1-8f29-3e4222001fc8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.593372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e5c7-f5ec-487f-a610-58d5eea046ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.593984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e5c7-f5ec-487f-a610-58d5eea046ab admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.594263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e5c7-f5ec-487f-a610-58d5eea046ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.594541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e5c7-f5ec-487f-a610-58d5eea046ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.595199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7e5c7-f5ec-487f-a610-58d5eea046ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.597128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7e5c7-f5ec-487f-a610-58d5eea046ab admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.627603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1072/2141] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:39:48 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:39:48.631901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.643600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f62ed-6387-4482-8394-efc9903eee8d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.720282 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f972e5-aa78-46f2-b022-b589d18c83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.720915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f972e5-aa78-46f2-b022-b589d18c83de admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.721201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f972e5-aa78-46f2-b022-b589d18c83de admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.721477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f972e5-aa78-46f2-b022-b589d18c83de admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.722148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f972e5-aa78-46f2-b022-b589d18c83de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.724116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f972e5-aa78-46f2-b022-b589d18c83de admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.751328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1070/2142] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:39:48 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:48.755634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e5c7-f5ec-487f-a610-58d5eea046ab admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.767891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e5c7-f5ec-487f-a610-58d5eea046ab admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.772714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e5035-5a1e-4169-8406-a2fd9249f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.773334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e5035-5a1e-4169-8406-a2fd9249f7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.773613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e5035-5a1e-4169-8406-a2fd9249f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.773887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e5035-5a1e-4169-8406-a2fd9249f7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.774759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e5035-5a1e-4169-8406-a2fd9249f7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.776364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e5035-5a1e-4169-8406-a2fd9249f7c9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.787528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1073/2143] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:39:48.791532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f972e5-aa78-46f2-b022-b589d18c83de admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.801802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f972e5-aa78-46f2-b022-b589d18c83de admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.806947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f2b7-b9ed-4dae-bc46-32990b756460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.807547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f2b7-b9ed-4dae-bc46-32990b756460 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.807837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f2b7-b9ed-4dae-bc46-32990b756460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.808155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f2b7-b9ed-4dae-bc46-32990b756460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.809097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034f2b7-b9ed-4dae-bc46-32990b756460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.811264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034f2b7-b9ed-4dae-bc46-32990b756460 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.823499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1071/2144] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:39:48.828219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e5035-5a1e-4169-8406-a2fd9249f7c9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.838428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e5035-5a1e-4169-8406-a2fd9249f7c9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.844453 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.845113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.845394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.845671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] PATH_INFO: `/v3/projects/987633593e0047b6a928bbb8fcf91cf8/users/bf40fc984d8e41228443ed6e669582e7/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.860843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987633593e0047b6a928bbb8fcf91cf8, user_id=bf40fc984d8e41228443ed6e669582e7, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.864377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.883454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1074/2145] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:39:48 2022] PUT /identity/v3/projects/987633593e0047b6a928bbb8fcf91cf8/users/bf40fc984d8e41228443ed6e669582e7/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:48.894452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1e07-c343-4368-9e3d-f3840e0e80c3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.894734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1e07-c343-4368-9e3d-f3840e0e80c3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.895006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1e07-c343-4368-9e3d-f3840e0e80c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.923884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-832a1e07-c343-4368-9e3d-f3840e0e80c3 None None] MFA Rules not processed for user `bf40fc984d8e41228443ed6e669582e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:48.925406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-832a1e07-c343-4368-9e3d-f3840e0e80c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:48.991030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1072/2146] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:49.002974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:49.004674 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:49.074901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ef51f-9d96-452b-8fb7-2bf3c8d6c621 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:49.078903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03250eb151044619c0f720f315b8509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:49.079563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:49.079880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:49.080186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:49.088917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:49.090422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:49.100419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1075/2147] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:39:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:39:54.199560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1079-697b-455f-8e39-a8a3b0286130 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:54.200088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1079-697b-455f-8e39-a8a3b0286130 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:54.200496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1079-697b-455f-8e39-a8a3b0286130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:54.222185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-85af1079-697b-455f-8e39-a8a3b0286130 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:54.223511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-85af1079-697b-455f-8e39-a8a3b0286130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:54.258426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:54.302741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1073/2148] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:39:54.359502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:54.361329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:54.447455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b535de-9c49-4abe-b8aa-3e3013d5fc42 service glance] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:54.453084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:54.453968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:54.454253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:54.455473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:54.475721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:54.477760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:54.487744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1076/2149] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:39:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:39:54.737761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a512a-8d43-4b6a-9c3b-37bc50719931 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:54.738075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a512a-8d43-4b6a-9c3b-37bc50719931 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:54.738652 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a512a-8d43-4b6a-9c3b-37bc50719931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:54.780197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f74a512a-8d43-4b6a-9c3b-37bc50719931 None None] MFA Rules not processed for user `e4a4c21d432448fcbb75e000741d5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:54.782022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f74a512a-8d43-4b6a-9c3b-37bc50719931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:54.864983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1074/2150] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:40:03.338225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:03.341676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:03.377981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:03.423572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344bde-0550-4bcd-a847-917bf2e30c56 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:03.442233 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:03.443191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:03.443689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:03.444142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] PATH_INFO: `/v3/users/10248f48507349ef9e6620db44b4ce07` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:03.445623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10248f48507349ef9e6620db44b4ce07)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:03.448169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:03.517164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10248f48507349ef9e6620db44b4ce07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:03.527965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10248f48507349ef9e6620db44b4ce07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:03.537157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10248f48507349ef9e6620db44b4ce07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:03.538084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10248f48507349ef9e6620db44b4ce07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:03.555036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10248f48507349ef9e6620db44b4ce07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:03.562541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1077/2151] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:40:03 2022] DELETE /identity/v3/users/10248f48507349ef9e6620db44b4ce07 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:03.567671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56f4d-ff91-4622-a74c-5b9155a7df35 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:03.568203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56f4d-ff91-4622-a74c-5b9155a7df35 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:03.568486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56f4d-ff91-4622-a74c-5b9155a7df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:03.590636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-dfb56f4d-ff91-4622-a74c-5b9155a7df35 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:03.591949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-dfb56f4d-ff91-4622-a74c-5b9155a7df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:03.660916 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1075/2152] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:40:03.672403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:03.673918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:03.751777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabff8f-380b-4ca5-8901-e4820a02d584 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:03.756332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcd70a-7d0a-40e4-81af-c6f05ad13ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:03.757266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcd70a-7d0a-40e4-81af-c6f05ad13ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:03.757562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcd70a-7d0a-40e4-81af-c6f05ad13ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:03.757949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcd70a-7d0a-40e4-81af-c6f05ad13ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:03.770231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcd70a-7d0a-40e4-81af-c6f05ad13ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:03.772032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcd70a-7d0a-40e4-81af-c6f05ad13ef9 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:03.788114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1078/2153] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:04.084348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56f4d-ff91-4622-a74c-5b9155a7df35 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.085869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-dfb56f4d-ff91-4622-a74c-5b9155a7df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:04.119740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56f4d-ff91-4622-a74c-5b9155a7df35 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.124812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.125476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.125761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.126219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] PATH_INFO: `/v3/projects/3921004ebb9c4f5785f722216423a1d8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.127583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3921004ebb9c4f5785f722216423a1d8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.129522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.194326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3921004ebb9c4f5785f722216423a1d8', 'request_id': 'req-87aa2b2a-6595-4468-9225-f8943caf0d8b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:04.203415 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3921004ebb9c4f5785f722216423a1d8', 'request_id': 'req-87aa2b2a-6595-4468-9225-f8943caf0d8b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:04.209500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3921004ebb9c4f5785f722216423a1d8', 'request_id': 'req-87aa2b2a-6595-4468-9225-f8943caf0d8b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:04.224687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] The token cache is being invalidate because project 3921004ebb9c4f5785f722216423a1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:40:04.224977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:04.225609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-87aa2b2a-6595-4468-9225-f8943caf0d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:04.227148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1076/2154] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:40:04 2022] DELETE /identity/v3/projects/3921004ebb9c4f5785f722216423a1d8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:04.233957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689e6d5-f798-4c93-b396-a8ea18b1e462 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.234425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689e6d5-f798-4c93-b396-a8ea18b1e462 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.234659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689e6d5-f798-4c93-b396-a8ea18b1e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.266489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3689e6d5-f798-4c93-b396-a8ea18b1e462 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:04.268179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3689e6d5-f798-4c93-b396-a8ea18b1e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:04.325984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:04.346107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1079/2155] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:04.355337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133cacc-799f-4d29-add0-4cf21a21092c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.355732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133cacc-799f-4d29-add0-4cf21a21092c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.356638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133cacc-799f-4d29-add0-4cf21a21092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.365853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:04.379291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a133cacc-799f-4d29-add0-4cf21a21092c None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:04.381150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a133cacc-799f-4d29-add0-4cf21a21092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:04.391105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1077/2156] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:40:04.396522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689e6d5-f798-4c93-b396-a8ea18b1e462 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.406351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689e6d5-f798-4c93-b396-a8ea18b1e462 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.411100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.411724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.412010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.412284 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.413013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:04.413315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.415103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.428701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1080/2157] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:04.433158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133cacc-799f-4d29-add0-4cf21a21092c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.444206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133cacc-799f-4d29-add0-4cf21a21092c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.449574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0b4be-659d-492a-93e2-d6104863ee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.450447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0b4be-659d-492a-93e2-d6104863ee40 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.450739 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0b4be-659d-492a-93e2-d6104863ee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.451038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0b4be-659d-492a-93e2-d6104863ee40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.451784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0b4be-659d-492a-93e2-d6104863ee40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.453744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0b4be-659d-492a-93e2-d6104863ee40 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.507448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1078/2158] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:40:04 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:40:04.509119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.532701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c065319-db29-4ddf-8a8c-fee0847b8353 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.631201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82872-dbaa-47cd-8b11-f49ac5ee0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.631891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82872-dbaa-47cd-8b11-f49ac5ee0331 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.632157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82872-dbaa-47cd-8b11-f49ac5ee0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.632431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82872-dbaa-47cd-8b11-f49ac5ee0331 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.633125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c82872-dbaa-47cd-8b11-f49ac5ee0331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.635242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c82872-dbaa-47cd-8b11-f49ac5ee0331 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.664097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1081/2159] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:40:04 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:40:04.667962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0b4be-659d-492a-93e2-d6104863ee40 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.683502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0b4be-659d-492a-93e2-d6104863ee40 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.689350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481c196-164c-45ba-94ac-a28e43ccb6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.690154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481c196-164c-45ba-94ac-a28e43ccb6af admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.690528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481c196-164c-45ba-94ac-a28e43ccb6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.690901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481c196-164c-45ba-94ac-a28e43ccb6af admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.691758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481c196-164c-45ba-94ac-a28e43ccb6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.693508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481c196-164c-45ba-94ac-a28e43ccb6af admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.705592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1079/2160] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:04.709721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82872-dbaa-47cd-8b11-f49ac5ee0331 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.721972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82872-dbaa-47cd-8b11-f49ac5ee0331 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.727289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc6eb-d9d4-417c-99d6-f5bb15a421e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.728040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc6eb-d9d4-417c-99d6-f5bb15a421e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.728418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc6eb-d9d4-417c-99d6-f5bb15a421e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.729076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc6eb-d9d4-417c-99d6-f5bb15a421e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.729827 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc6eb-d9d4-417c-99d6-f5bb15a421e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.732777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc6eb-d9d4-417c-99d6-f5bb15a421e6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.746612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1082/2161] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:04.750877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481c196-164c-45ba-94ac-a28e43ccb6af admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.761417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481c196-164c-45ba-94ac-a28e43ccb6af admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.767095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.767829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.768240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.768527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] PATH_INFO: `/v3/projects/05708e99facb4eb68ba0a4ce6a04a78c/users/2b864aa8a7a04f11813ac1ac62d9fd34/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.787108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05708e99facb4eb68ba0a4ce6a04a78c, user_id=2b864aa8a7a04f11813ac1ac62d9fd34, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.789631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.804986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1080/2162] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:40:04 2022] PUT /identity/v3/projects/05708e99facb4eb68ba0a4ce6a04a78c/users/2b864aa8a7a04f11813ac1ac62d9fd34/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:04.810688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc8c2d-d70e-4b46-b4b8-28b6bbfea2c8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.811486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc8c2d-d70e-4b46-b4b8-28b6bbfea2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.811486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc8c2d-d70e-4b46-b4b8-28b6bbfea2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.841024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3dfc8c2d-d70e-4b46-b4b8-28b6bbfea2c8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:04.842484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3dfc8c2d-d70e-4b46-b4b8-28b6bbfea2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:04.944141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1083/2163] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:04.956564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.958961 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:05.066382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0939e57-5b02-461d-8ba6-a3638d3c96f6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:05.070774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285126-e4a8-46a6-8b75-bd60ec0a77d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:05.075521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285126-e4a8-46a6-8b75-bd60ec0a77d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:05.075521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285126-e4a8-46a6-8b75-bd60ec0a77d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:05.075521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285126-e4a8-46a6-8b75-bd60ec0a77d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:05.087967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96285126-e4a8-46a6-8b75-bd60ec0a77d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:05.089735 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96285126-e4a8-46a6-8b75-bd60ec0a77d4 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:05.102533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1081/2164] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:11.146923 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cfa9-8919-4a64-9ac6-5edbdb514de9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.147656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cfa9-8919-4a64-9ac6-5edbdb514de9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.147656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cfa9-8919-4a64-9ac6-5edbdb514de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.202028 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1c11cfa9-8919-4a64-9ac6-5edbdb514de9 None None] MFA Rules not processed for user `2b864aa8a7a04f11813ac1ac62d9fd34`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:11.203412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c11cfa9-8919-4a64-9ac6-5edbdb514de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:11.281066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:11.333885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1084/2165] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:11.339585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285126-e4a8-46a6-8b75-bd60ec0a77d4 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:11.352731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285126-e4a8-46a6-8b75-bd60ec0a77d4 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:11.359291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea65776-1d98-412f-a96b-ea72956513a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:11.360246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea65776-1d98-412f-a96b-ea72956513a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.360746 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea65776-1d98-412f-a96b-ea72956513a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.361249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea65776-1d98-412f-a96b-ea72956513a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.362157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea65776-1d98-412f-a96b-ea72956513a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:11.364374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea65776-1d98-412f-a96b-ea72956513a6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:11.408794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1082/2166] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:40:11 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:11.413151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11cfa9-8919-4a64-9ac6-5edbdb514de9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:11.432960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11cfa9-8919-4a64-9ac6-5edbdb514de9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:11.510350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3916a9-0127-4c59-b96e-3225dc4f7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:11.511003 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3916a9-0127-4c59-b96e-3225dc4f7a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.511362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3916a9-0127-4c59-b96e-3225dc4f7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.511681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3916a9-0127-4c59-b96e-3225dc4f7a8d admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.512944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3916a9-0127-4c59-b96e-3225dc4f7a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:11.515065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3916a9-0127-4c59-b96e-3225dc4f7a8d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:11.545931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1085/2167] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:40:11 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:40:11.550695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea65776-1d98-412f-a96b-ea72956513a6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:11.563654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea65776-1d98-412f-a96b-ea72956513a6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:11.569037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0ad33-b392-44ca-90f7-612c3148b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:11.569773 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0ad33-b392-44ca-90f7-612c3148b9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.570270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0ad33-b392-44ca-90f7-612c3148b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.570563 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0ad33-b392-44ca-90f7-612c3148b9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.572255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0ad33-b392-44ca-90f7-612c3148b9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:11.574106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0ad33-b392-44ca-90f7-612c3148b9dd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:11.589312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1083/2168] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:11.593930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3916a9-0127-4c59-b96e-3225dc4f7a8d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:11.606505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3916a9-0127-4c59-b96e-3225dc4f7a8d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:11.635160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96caa4-1018-4746-9917-78d55394e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:11.635901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96caa4-1018-4746-9917-78d55394e6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.636188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96caa4-1018-4746-9917-78d55394e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.636468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96caa4-1018-4746-9917-78d55394e6f4 admin admin] PATH_INFO: `/v3/projects/80d4c96ba03b432f8afbfa4bbdcd7eee/users/0d7b3918f44e44a48e92cc211c04788c/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.658573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96caa4-1018-4746-9917-78d55394e6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d4c96ba03b432f8afbfa4bbdcd7eee, user_id=0d7b3918f44e44a48e92cc211c04788c, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:11.661745 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96caa4-1018-4746-9917-78d55394e6f4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:11.695718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1086/2169] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:40:11 2022] PUT /identity/v3/projects/80d4c96ba03b432f8afbfa4bbdcd7eee/users/0d7b3918f44e44a48e92cc211c04788c/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:11.699831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0ad33-b392-44ca-90f7-612c3148b9dd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:11.719515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0ad33-b392-44ca-90f7-612c3148b9dd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:11.832518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc61e4-ba20-41e1-b5e8-535ecabc9199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:11.833164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc61e4-ba20-41e1-b5e8-535ecabc9199 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.833449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc61e4-ba20-41e1-b5e8-535ecabc9199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.833728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc61e4-ba20-41e1-b5e8-535ecabc9199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.834659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc61e4-ba20-41e1-b5e8-535ecabc9199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:11.836774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc61e4-ba20-41e1-b5e8-535ecabc9199 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:11.848587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1084/2170] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:11.853187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96caa4-1018-4746-9917-78d55394e6f4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:11.867744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96caa4-1018-4746-9917-78d55394e6f4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:11.882920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:11.883660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.883948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.884234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] PATH_INFO: `/v3/projects/80d4c96ba03b432f8afbfa4bbdcd7eee/users/0d7b3918f44e44a48e92cc211c04788c/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.886783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d4c96ba03b432f8afbfa4bbdcd7eee, user_id=0d7b3918f44e44a48e92cc211c04788c, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:11.890497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:11.903508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1087/2171] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:40:11 2022] PUT /identity/v3/projects/80d4c96ba03b432f8afbfa4bbdcd7eee/users/0d7b3918f44e44a48e92cc211c04788c/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:19.950812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74482cf-3c32-42f1-8247-4e40f5f01c36 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:19.951783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74482cf-3c32-42f1-8247-4e40f5f01c36 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:19.951783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74482cf-3c32-42f1-8247-4e40f5f01c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:19.969870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:20.019610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a74482cf-3c32-42f1-8247-4e40f5f01c36 None None] MFA Rules not processed for user `0d7b3918f44e44a48e92cc211c04788c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:20.020869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a74482cf-3c32-42f1-8247-4e40f5f01c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:20.166431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1085/2172] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:20.192615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:20.199188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:20.420225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40781-8d7c-4781-a148-4150103d9be5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:20.441149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cee0a-220d-4555-8e7f-587bd3694b98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:20.450526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cee0a-220d-4555-8e7f-587bd3694b98 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:20.452018 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cee0a-220d-4555-8e7f-587bd3694b98 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:20.452598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cee0a-220d-4555-8e7f-587bd3694b98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:20.621977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:20.736084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cee0a-220d-4555-8e7f-587bd3694b98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:20.739268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cee0a-220d-4555-8e7f-587bd3694b98 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:20.771092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1088/2173] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:23.240525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564ae0-93be-403f-9d3b-cdc97dfa003b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:23.241467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564ae0-93be-403f-9d3b-cdc97dfa003b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:23.241915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564ae0-93be-403f-9d3b-cdc97dfa003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:23.265512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a5564ae0-93be-403f-9d3b-cdc97dfa003b None None] MFA Rules not processed for user `2b864aa8a7a04f11813ac1ac62d9fd34`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:23.266908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a5564ae0-93be-403f-9d3b-cdc97dfa003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:23.274150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1086/2174] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:23.793126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307100a-b1a3-4293-9942-2c5dfb2ffb1d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:23.794629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307100a-b1a3-4293-9942-2c5dfb2ffb1d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:23.795280 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307100a-b1a3-4293-9942-2c5dfb2ffb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:23.822239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8307100a-b1a3-4293-9942-2c5dfb2ffb1d None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:23.824237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8307100a-b1a3-4293-9942-2c5dfb2ffb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:23.904643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1089/2175] 10.222.0.71 () {58 vars in 967 bytes} [Mon Aug 1 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:23.925172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5564ae0-93be-403f-9d3b-cdc97dfa003b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:23.928252 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a5564ae0-93be-403f-9d3b-cdc97dfa003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:24.019211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5564ae0-93be-403f-9d3b-cdc97dfa003b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:24.031945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed40cc-fe86-409b-8b95-48d24c3053cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:24.032611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed40cc-fe86-409b-8b95-48d24c3053cd service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:24.032905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed40cc-fe86-409b-8b95-48d24c3053cd service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:24.033182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed40cc-fe86-409b-8b95-48d24c3053cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:24.044163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed40cc-fe86-409b-8b95-48d24c3053cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:24.045818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed40cc-fe86-409b-8b95-48d24c3053cd service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:24.056498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1087/2176] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:40:26.409195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a13e-be82-4c28-b9f6-37a42d8848c5 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:26.410059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a13e-be82-4c28-b9f6-37a42d8848c5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:26.410344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a13e-be82-4c28-b9f6-37a42d8848c5 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:26.412139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1090/2177] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:40:26.443836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bd872-d073-4e5f-8c57-2cea1deb1d70 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:26.444403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bd872-d073-4e5f-8c57-2cea1deb1d70 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:26.444403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bd872-d073-4e5f-8c57-2cea1deb1d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:26.482993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-720bd872-d073-4e5f-8c57-2cea1deb1d70 None None] MFA Rules not processed for user `9365ba08205148e08c3a4f20d67125a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:26.484802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-720bd872-d073-4e5f-8c57-2cea1deb1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:26.491923 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39a13e-be82-4c28-b9f6-37a42d8848c5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:26.493740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2b39a13e-be82-4c28-b9f6-37a42d8848c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:26.580910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39a13e-be82-4c28-b9f6-37a42d8848c5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:26.581423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1088/2178] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:40:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:26.595215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:26.596121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:26.596537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:26.596884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] PATH_INFO: `/v3/users/55e12a10e720431d8fa1f3331c468bd4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:26.598238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e12a10e720431d8fa1f3331c468bd4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:26.599570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bd872-d073-4e5f-8c57-2cea1deb1d70 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:26.600512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:26.600946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-720bd872-d073-4e5f-8c57-2cea1deb1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:26.614654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bd872-d073-4e5f-8c57-2cea1deb1d70 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:26.621818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269339-fb5a-464b-82d5-e602e400aa92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:26.622515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269339-fb5a-464b-82d5-e602e400aa92 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:26.622795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269339-fb5a-464b-82d5-e602e400aa92 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:26.623141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269339-fb5a-464b-82d5-e602e400aa92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:26.630121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:26.632817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269339-fb5a-464b-82d5-e602e400aa92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:26.634528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269339-fb5a-464b-82d5-e602e400aa92 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:26.647836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1089/2179] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:26.679926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e12a10e720431d8fa1f3331c468bd4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:26.696783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e12a10e720431d8fa1f3331c468bd4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:26.705019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e12a10e720431d8fa1f3331c468bd4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:26.705849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e12a10e720431d8fa1f3331c468bd4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:26.722377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e12a10e720431d8fa1f3331c468bd4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:26.725685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:26.730465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1091/2180] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:40:26 2022] DELETE /identity/v3/users/55e12a10e720431d8fa1f3331c468bd4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:26.925853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269339-fb5a-464b-82d5-e602e400aa92 service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:26.946991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269339-fb5a-464b-82d5-e602e400aa92 service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:27.027988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:27.027988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:27.027988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:27.027988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] PATH_INFO: `/v3/projects/7a9934d2cb4b43d682d1d4bf6b64b911` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:27.029738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9934d2cb4b43d682d1d4bf6b64b911)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:27.032815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:27.090904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9934d2cb4b43d682d1d4bf6b64b911', 'request_id': 'req-4bcd7312-24a5-452f-b574-5235c3a8f89d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:27.097991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9934d2cb4b43d682d1d4bf6b64b911', 'request_id': 'req-4bcd7312-24a5-452f-b574-5235c3a8f89d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:27.104207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9934d2cb4b43d682d1d4bf6b64b911', 'request_id': 'req-4bcd7312-24a5-452f-b574-5235c3a8f89d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:27.118686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] The token cache is being invalidate because project 7a9934d2cb4b43d682d1d4bf6b64b911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:40:27.118987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:27.119822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4bcd7312-24a5-452f-b574-5235c3a8f89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:27.122258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1090/2181] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:40:26 2022] DELETE /identity/v3/projects/7a9934d2cb4b43d682d1d4bf6b64b911 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:34.739072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:34.740821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:34.754670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb914e-c98e-4918-a875-cb75993b504f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:34.813890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:34.814583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:34.814891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:34.815172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] PATH_INFO: `/v3/users/bf40fc984d8e41228443ed6e669582e7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:34.816402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf40fc984d8e41228443ed6e669582e7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:34.818377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:34.866922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf40fc984d8e41228443ed6e669582e7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:34.875769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf40fc984d8e41228443ed6e669582e7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:34.883160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf40fc984d8e41228443ed6e669582e7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:34.883876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf40fc984d8e41228443ed6e669582e7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:34.896382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf40fc984d8e41228443ed6e669582e7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:34.902391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1092/2182] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:40:34 2022] DELETE /identity/v3/users/bf40fc984d8e41228443ed6e669582e7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:34.907428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a973a9-e2db-4058-9e69-a74021bfbeca None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:34.907959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a973a9-e2db-4058-9e69-a74021bfbeca None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:34.908075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a973a9-e2db-4058-9e69-a74021bfbeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:34.930692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e4a973a9-e2db-4058-9e69-a74021bfbeca None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:34.931942 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e4a973a9-e2db-4058-9e69-a74021bfbeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:34.994403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1091/2183] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:35.004600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:35.006090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:35.073573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010885af-cd71-4a41-b123-94ef4dbdd9e3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:35.077437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49955c-513d-4576-abaf-b6a8cc5a65e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:35.078066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49955c-513d-4576-abaf-b6a8cc5a65e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.078348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49955c-513d-4576-abaf-b6a8cc5a65e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.078623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49955c-513d-4576-abaf-b6a8cc5a65e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.088564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49955c-513d-4576-abaf-b6a8cc5a65e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:35.090047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49955c-513d-4576-abaf-b6a8cc5a65e1 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:35.099985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1093/2184] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:40:35.393927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a973a9-e2db-4058-9e69-a74021bfbeca None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:35.395441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e4a973a9-e2db-4058-9e69-a74021bfbeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:35.408178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a973a9-e2db-4058-9e69-a74021bfbeca None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:35.412751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:35.413422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.413698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.413988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] PATH_INFO: `/v3/projects/987633593e0047b6a928bbb8fcf91cf8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.415108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987633593e0047b6a928bbb8fcf91cf8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:35.417071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:35.441587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:35.470231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987633593e0047b6a928bbb8fcf91cf8', 'request_id': 'req-3cdac22f-748e-40c5-a768-134c3a1b04e8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:35.476616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987633593e0047b6a928bbb8fcf91cf8', 'request_id': 'req-3cdac22f-748e-40c5-a768-134c3a1b04e8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:35.487933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987633593e0047b6a928bbb8fcf91cf8', 'request_id': 'req-3cdac22f-748e-40c5-a768-134c3a1b04e8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:35.503703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] The token cache is being invalidate because project 987633593e0047b6a928bbb8fcf91cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:40:35.504194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:35.504829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3cdac22f-748e-40c5-a768-134c3a1b04e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:35.506347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1092/2185] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:40:35 2022] DELETE /identity/v3/projects/987633593e0047b6a928bbb8fcf91cf8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:35.512015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d9b27-fa72-4945-b13c-8154edd2e151 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.512377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d9b27-fa72-4945-b13c-8154edd2e151 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.512657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d9b27-fa72-4945-b13c-8154edd2e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.532604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-130d9b27-fa72-4945-b13c-8154edd2e151 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:35.533799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-130d9b27-fa72-4945-b13c-8154edd2e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:35.548811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:35.599417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1094/2186] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:35.609016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120297-d1e1-4670-a48b-78efda0e02c0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.609299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120297-d1e1-4670-a48b-78efda0e02c0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.609582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120297-d1e1-4670-a48b-78efda0e02c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.630309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-95120297-d1e1-4670-a48b-78efda0e02c0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:35.631560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-95120297-d1e1-4670-a48b-78efda0e02c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:35.640254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1093/2187] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:35.645126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d9b27-fa72-4945-b13c-8154edd2e151 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:35.657189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d9b27-fa72-4945-b13c-8154edd2e151 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:35.662114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:35.662758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.663041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.663316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.664042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:35.664347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:35.665974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:35.680069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1095/2188] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:35.684648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95120297-d1e1-4670-a48b-78efda0e02c0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:35.695156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95120297-d1e1-4670-a48b-78efda0e02c0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:35.700919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd313a-3db3-4ecf-8577-e3f24982f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:35.702650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd313a-3db3-4ecf-8577-e3f24982f72e admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.702650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd313a-3db3-4ecf-8577-e3f24982f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.702650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd313a-3db3-4ecf-8577-e3f24982f72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.702947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd313a-3db3-4ecf-8577-e3f24982f72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:35.704865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd313a-3db3-4ecf-8577-e3f24982f72e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:35.736998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1094/2189] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:40:35 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:35.741548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:35.754547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583933b4-308d-4151-bbc6-e1fefcced1b9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:35.812890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde8c5a-2977-42ab-90cd-1caae4d44cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:35.813512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde8c5a-2977-42ab-90cd-1caae4d44cda admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.813799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde8c5a-2977-42ab-90cd-1caae4d44cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.814079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde8c5a-2977-42ab-90cd-1caae4d44cda admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.814760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde8c5a-2977-42ab-90cd-1caae4d44cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:35.816721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde8c5a-2977-42ab-90cd-1caae4d44cda admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:35.840779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1096/2190] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:40:35 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:35.844874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd313a-3db3-4ecf-8577-e3f24982f72e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:35.856086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd313a-3db3-4ecf-8577-e3f24982f72e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:35.861401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd45a7-261c-4171-901a-7e2c808626a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:35.862025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd45a7-261c-4171-901a-7e2c808626a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.862304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd45a7-261c-4171-901a-7e2c808626a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.862688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd45a7-261c-4171-901a-7e2c808626a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.863409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd45a7-261c-4171-901a-7e2c808626a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:35.865017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd45a7-261c-4171-901a-7e2c808626a4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:35.875843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1095/2191] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:35.880090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde8c5a-2977-42ab-90cd-1caae4d44cda admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:35.891141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde8c5a-2977-42ab-90cd-1caae4d44cda admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:35.895892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc04c7-30b4-44e1-80e0-b5cba593f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:35.896514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc04c7-30b4-44e1-80e0-b5cba593f708 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.896798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc04c7-30b4-44e1-80e0-b5cba593f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.897077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc04c7-30b4-44e1-80e0-b5cba593f708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.897774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc04c7-30b4-44e1-80e0-b5cba593f708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:35.899418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc04c7-30b4-44e1-80e0-b5cba593f708 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:35.911203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1097/2192] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:40:35.915801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd45a7-261c-4171-901a-7e2c808626a4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:35.926234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd45a7-261c-4171-901a-7e2c808626a4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:35.930863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:35.931565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.931851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.932127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] PATH_INFO: `/v3/projects/afe9967bc5be489891becfe858cc7092/users/49eff475d6f04c048350ccc91a84ba73/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:35.947498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe9967bc5be489891becfe858cc7092, user_id=49eff475d6f04c048350ccc91a84ba73, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:35.950674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:35.963783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1096/2193] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:40:35 2022] PUT /identity/v3/projects/afe9967bc5be489891becfe858cc7092/users/49eff475d6f04c048350ccc91a84ba73/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:35.974930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a6fb3-31e1-4af7-9d70-f039532eb4e7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:35.975221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a6fb3-31e1-4af7-9d70-f039532eb4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:35.975527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a6fb3-31e1-4af7-9d70-f039532eb4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:36.004278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-547a6fb3-31e1-4af7-9d70-f039532eb4e7 None None] MFA Rules not processed for user `49eff475d6f04c048350ccc91a84ba73`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:36.005555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-547a6fb3-31e1-4af7-9d70-f039532eb4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:36.070906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1098/2194] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:36.083603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:36.085327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:36.151720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02f9d-a28a-4df6-b9c0-d3e3d0442956 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:36.155848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ac090-7a45-4cf7-9ff6-1cf87f3559a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:36.156463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ac090-7a45-4cf7-9ff6-1cf87f3559a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:36.156743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ac090-7a45-4cf7-9ff6-1cf87f3559a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:36.157016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ac090-7a45-4cf7-9ff6-1cf87f3559a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:36.167277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ac090-7a45-4cf7-9ff6-1cf87f3559a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:36.168775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ac090-7a45-4cf7-9ff6-1cf87f3559a6 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:36.178330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1097/2195] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:39.795920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a6fb3-31e1-4af7-9d70-f039532eb4e7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:39.814123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:39.863820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a6fb3-31e1-4af7-9d70-f039532eb4e7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:39.868311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:39.868976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:39.869259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:39.869545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] PATH_INFO: `/v3/users/49eff475d6f04c048350ccc91a84ba73` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:39.870698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49eff475d6f04c048350ccc91a84ba73)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:39.873178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:39.921435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49eff475d6f04c048350ccc91a84ba73'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:39.930479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49eff475d6f04c048350ccc91a84ba73'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:39.938568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49eff475d6f04c048350ccc91a84ba73'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:39.939221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49eff475d6f04c048350ccc91a84ba73'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:39.951651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49eff475d6f04c048350ccc91a84ba73'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:39.957478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1099/2196] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:40:39 2022] DELETE /identity/v3/users/49eff475d6f04c048350ccc91a84ba73 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:39.961894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839524-b637-413c-8df0-15d5fa761978 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:39.962367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839524-b637-413c-8df0-15d5fa761978 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:39.962493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839524-b637-413c-8df0-15d5fa761978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:39.981594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d3839524-b637-413c-8df0-15d5fa761978 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:39.982792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d3839524-b637-413c-8df0-15d5fa761978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:40.026813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:40.044068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1098/2197] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:40.053968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:40.055360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:40.112066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d55f10-1f71-483c-9b56-11f36bdac746 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:40.115755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c286a1e-eab9-4d10-9e50-82b9edc60f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:40.116372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286a1e-eab9-4d10-9e50-82b9edc60f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.116654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286a1e-eab9-4d10-9e50-82b9edc60f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.116929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286a1e-eab9-4d10-9e50-82b9edc60f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.127012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c286a1e-eab9-4d10-9e50-82b9edc60f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:40.128481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c286a1e-eab9-4d10-9e50-82b9edc60f06 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:40.138541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1100/2198] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:40:40.420020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3839524-b637-413c-8df0-15d5fa761978 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:40.421726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d3839524-b637-413c-8df0-15d5fa761978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:40.437244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3839524-b637-413c-8df0-15d5fa761978 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:40.442804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:40.443529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.443793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.444110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] PATH_INFO: `/v3/projects/afe9967bc5be489891becfe858cc7092` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.445456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe9967bc5be489891becfe858cc7092)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:40.447719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:40.499513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe9967bc5be489891becfe858cc7092', 'request_id': 'req-cce41f9f-6eb4-44ed-b502-4fa683673b20'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:40.505698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe9967bc5be489891becfe858cc7092', 'request_id': 'req-cce41f9f-6eb4-44ed-b502-4fa683673b20'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:40.511302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe9967bc5be489891becfe858cc7092', 'request_id': 'req-cce41f9f-6eb4-44ed-b502-4fa683673b20'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:40.524445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] The token cache is being invalidate because project afe9967bc5be489891becfe858cc7092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:40:40.524684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:40.525283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cce41f9f-6eb4-44ed-b502-4fa683673b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:40.526809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1099/2199] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:40:40 2022] DELETE /identity/v3/projects/afe9967bc5be489891becfe858cc7092 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:40.531964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74f0d-0156-4a19-ac40-890a34f26ac0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.532140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74f0d-0156-4a19-ac40-890a34f26ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.532411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74f0d-0156-4a19-ac40-890a34f26ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.554560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-27b74f0d-0156-4a19-ac40-890a34f26ac0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:40.555822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-27b74f0d-0156-4a19-ac40-890a34f26ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:40.591806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:40.622215 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1101/2200] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:40.630107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e87dc-5f08-4b7f-80e6-9ff61a7e973d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.630398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e87dc-5f08-4b7f-80e6-9ff61a7e973d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.630690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e87dc-5f08-4b7f-80e6-9ff61a7e973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.651777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b67e87dc-5f08-4b7f-80e6-9ff61a7e973d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:40.653522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b67e87dc-5f08-4b7f-80e6-9ff61a7e973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:40.662660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1100/2201] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:40.667154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74f0d-0156-4a19-ac40-890a34f26ac0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:40.678623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74f0d-0156-4a19-ac40-890a34f26ac0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:40.683271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:40.683912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.684191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.684462 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.685258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:40.685558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:40.687156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:40.699880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1102/2202] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:40.704543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e87dc-5f08-4b7f-80e6-9ff61a7e973d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:40.716135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e87dc-5f08-4b7f-80e6-9ff61a7e973d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:40.720794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7505995-23c2-458a-ae11-b21787325b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:40.721419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505995-23c2-458a-ae11-b21787325b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.721703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505995-23c2-458a-ae11-b21787325b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.721984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505995-23c2-458a-ae11-b21787325b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.722651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7505995-23c2-458a-ae11-b21787325b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:40.724645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7505995-23c2-458a-ae11-b21787325b4d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:40.760616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1101/2203] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:40:40 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:40.761611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:40.777213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfeef-589d-46ce-9d85-ce3a475166b0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:40.839049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d8ba2-bfcf-416d-adad-d027546e4cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:40.840379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d8ba2-bfcf-416d-adad-d027546e4cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.840666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d8ba2-bfcf-416d-adad-d027546e4cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.840941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d8ba2-bfcf-416d-adad-d027546e4cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.841670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d8ba2-bfcf-416d-adad-d027546e4cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:40.843651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d8ba2-bfcf-416d-adad-d027546e4cb4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:40.866913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1103/2204] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:40:40 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:40:40.871928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7505995-23c2-458a-ae11-b21787325b4d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:40.886556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7505995-23c2-458a-ae11-b21787325b4d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:40.891886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee7a4c-4dab-4a33-944a-76e998a0c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:40.892591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7a4c-4dab-4a33-944a-76e998a0c004 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.892878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7a4c-4dab-4a33-944a-76e998a0c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.893151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7a4c-4dab-4a33-944a-76e998a0c004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.893847 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee7a4c-4dab-4a33-944a-76e998a0c004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:40.895578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee7a4c-4dab-4a33-944a-76e998a0c004 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:40.906658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1102/2205] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:40.910953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d8ba2-bfcf-416d-adad-d027546e4cb4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:40.921933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d8ba2-bfcf-416d-adad-d027546e4cb4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:40.927105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438c10c-7cf6-4e92-8ab8-1ba6cecaebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:40.927761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438c10c-7cf6-4e92-8ab8-1ba6cecaebdc admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.928041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438c10c-7cf6-4e92-8ab8-1ba6cecaebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.928313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438c10c-7cf6-4e92-8ab8-1ba6cecaebdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.929005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438c10c-7cf6-4e92-8ab8-1ba6cecaebdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:40.930625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438c10c-7cf6-4e92-8ab8-1ba6cecaebdc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:40.942099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1104/2206] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:40.947723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee7a4c-4dab-4a33-944a-76e998a0c004 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:40.960086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee7a4c-4dab-4a33-944a-76e998a0c004 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:40.964723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:40.965903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:40.966188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:40.966586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] PATH_INFO: `/v3/projects/6c2bf6d5fdbb4ffb879a0edd9fc69f09/users/079b6464613e46c6bc7b5c27146f1397/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:40.982367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2bf6d5fdbb4ffb879a0edd9fc69f09, user_id=079b6464613e46c6bc7b5c27146f1397, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:40.985291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:40.998031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1103/2207] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:40:40 2022] PUT /identity/v3/projects/6c2bf6d5fdbb4ffb879a0edd9fc69f09/users/079b6464613e46c6bc7b5c27146f1397/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:41.064097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb807-d2dc-4438-8048-5ec69d1dec4e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:41.064388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb807-d2dc-4438-8048-5ec69d1dec4e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:41.064675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb807-d2dc-4438-8048-5ec69d1dec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:41.093341 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-537cb807-d2dc-4438-8048-5ec69d1dec4e None None] MFA Rules not processed for user `079b6464613e46c6bc7b5c27146f1397`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:41.094577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-537cb807-d2dc-4438-8048-5ec69d1dec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:41.158330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1105/2208] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:41.168908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:41.170617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:41.227357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36129c54-7a8c-40da-99cd-855a111e4a48 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:41.230976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18db0d-5dae-4869-9338-969a0997167c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:41.231629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18db0d-5dae-4869-9338-969a0997167c service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:41.231917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18db0d-5dae-4869-9338-969a0997167c service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:41.232202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18db0d-5dae-4869-9338-969a0997167c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:41.241174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18db0d-5dae-4869-9338-969a0997167c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:41.242634 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18db0d-5dae-4869-9338-969a0997167c service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:41.252639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1104/2209] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:50.510409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cb807-d2dc-4438-8048-5ec69d1dec4e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:50.511885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-537cb807-d2dc-4438-8048-5ec69d1dec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:50.547935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:50.582599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cb807-d2dc-4438-8048-5ec69d1dec4e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:50.587584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a981-701f-451d-8ff4-00217af3324e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:50.588210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a981-701f-451d-8ff4-00217af3324e service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:50.588499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a981-701f-451d-8ff4-00217af3324e service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:50.588775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a981-701f-451d-8ff4-00217af3324e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:50.591079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-afd3a981-701f-451d-8ff4-00217af3324e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:50.602746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a981-701f-451d-8ff4-00217af3324e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:50.604387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a981-701f-451d-8ff4-00217af3324e service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:50.615694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1106/2210] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:40:51.247679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:53.586794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18db0d-5dae-4869-9338-969a0997167c service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:53.659623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18db0d-5dae-4869-9338-969a0997167c service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:53.664702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:53.665732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:53.666221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:53.666716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] PATH_INFO: `/v3/users/079b6464613e46c6bc7b5c27146f1397` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:53.669203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=079b6464613e46c6bc7b5c27146f1397)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:53.671978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:53.727766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079b6464613e46c6bc7b5c27146f1397'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:53.737038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079b6464613e46c6bc7b5c27146f1397'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:53.737691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079b6464613e46c6bc7b5c27146f1397'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:53.752405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079b6464613e46c6bc7b5c27146f1397'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:53.753654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079b6464613e46c6bc7b5c27146f1397'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:53.769060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1105/2211] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:40:53 2022] DELETE /identity/v3/users/079b6464613e46c6bc7b5c27146f1397 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:53.773721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88075bcb-e878-4417-b103-3a91c0c74f6d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:53.774242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88075bcb-e878-4417-b103-3a91c0c74f6d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:53.774342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88075bcb-e878-4417-b103-3a91c0c74f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:53.795344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-88075bcb-e878-4417-b103-3a91c0c74f6d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:53.797239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-88075bcb-e878-4417-b103-3a91c0c74f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:53.868565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1107/2212] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:53.878990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:53.880449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:53.942325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63bea-f94c-46b8-a474-a4013134cde3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:53.946032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e44e58-33a5-4ffd-b59c-92b50eb256ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:53.946654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e44e58-33a5-4ffd-b59c-92b50eb256ea service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:53.946936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e44e58-33a5-4ffd-b59c-92b50eb256ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:53.947212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e44e58-33a5-4ffd-b59c-92b50eb256ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:53.956433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e44e58-33a5-4ffd-b59c-92b50eb256ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:53.958524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e44e58-33a5-4ffd-b59c-92b50eb256ea service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:53.969395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1106/2213] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:54.253447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88075bcb-e878-4417-b103-3a91c0c74f6d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:54.255041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-88075bcb-e878-4417-b103-3a91c0c74f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:54.267208 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88075bcb-e878-4417-b103-3a91c0c74f6d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:54.271991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:54.272758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.273049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.273330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] PATH_INFO: `/v3/projects/6c2bf6d5fdbb4ffb879a0edd9fc69f09` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.274542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2bf6d5fdbb4ffb879a0edd9fc69f09)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:54.276508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:54.325209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2bf6d5fdbb4ffb879a0edd9fc69f09', 'request_id': 'req-d78664dc-5028-4088-9e3f-75aebbed4dd2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:54.332670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2bf6d5fdbb4ffb879a0edd9fc69f09', 'request_id': 'req-d78664dc-5028-4088-9e3f-75aebbed4dd2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:54.338241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2bf6d5fdbb4ffb879a0edd9fc69f09', 'request_id': 'req-d78664dc-5028-4088-9e3f-75aebbed4dd2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:54.350090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] The token cache is being invalidate because project 6c2bf6d5fdbb4ffb879a0edd9fc69f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:40:54.350389 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:54.351036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d78664dc-5028-4088-9e3f-75aebbed4dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:54.352633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1108/2214] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:40:54 2022] DELETE /identity/v3/projects/6c2bf6d5fdbb4ffb879a0edd9fc69f09 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:54.358760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd40e96-0634-477d-bb43-395ade4a7842 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.359263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd40e96-0634-477d-bb43-395ade4a7842 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.359696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd40e96-0634-477d-bb43-395ade4a7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.379247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8fd40e96-0634-477d-bb43-395ade4a7842 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:54.380420 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8fd40e96-0634-477d-bb43-395ade4a7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:54.397351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:54.455159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1107/2215] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:54.463249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a0b3a-8f33-4ae9-a300-99fa04b28f2a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.463565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a0b3a-8f33-4ae9-a300-99fa04b28f2a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.463842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a0b3a-8f33-4ae9-a300-99fa04b28f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.485226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b86a0b3a-8f33-4ae9-a300-99fa04b28f2a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:54.486438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b86a0b3a-8f33-4ae9-a300-99fa04b28f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:54.494174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1109/2216] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:54.498804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd40e96-0634-477d-bb43-395ade4a7842 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:54.508926 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd40e96-0634-477d-bb43-395ade4a7842 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:54.514525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:54.515151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.515591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.515879 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.516579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:54.516890 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:54.518512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:54.531574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1108/2217] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:54.535949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a0b3a-8f33-4ae9-a300-99fa04b28f2a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:54.545264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a0b3a-8f33-4ae9-a300-99fa04b28f2a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:54.550158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f85183-1b71-4a5a-b91d-24c90a784105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:54.550760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85183-1b71-4a5a-b91d-24c90a784105 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.551296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85183-1b71-4a5a-b91d-24c90a784105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.551600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85183-1b71-4a5a-b91d-24c90a784105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.552261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f85183-1b71-4a5a-b91d-24c90a784105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:54.554166 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f85183-1b71-4a5a-b91d-24c90a784105 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:54.580721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1110/2218] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:40:54 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:54.584912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:54.595662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd77179-8240-4e50-bd4e-b1e6e8f33c06 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:54.654285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ba1b-b05c-447d-b7be-7f4e058b94fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:54.654930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ba1b-b05c-447d-b7be-7f4e058b94fb admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.655208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ba1b-b05c-447d-b7be-7f4e058b94fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.655637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ba1b-b05c-447d-b7be-7f4e058b94fb admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.656313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39ba1b-b05c-447d-b7be-7f4e058b94fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:54.658235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39ba1b-b05c-447d-b7be-7f4e058b94fb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:54.680568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1109/2219] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:40:54 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:40:54.685012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f85183-1b71-4a5a-b91d-24c90a784105 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:54.695521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f85183-1b71-4a5a-b91d-24c90a784105 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:54.700720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140d627-da3c-460e-bdb4-e199fad51722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:54.701350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140d627-da3c-460e-bdb4-e199fad51722 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.701686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140d627-da3c-460e-bdb4-e199fad51722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.701964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140d627-da3c-460e-bdb4-e199fad51722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.702858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140d627-da3c-460e-bdb4-e199fad51722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:54.704511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140d627-da3c-460e-bdb4-e199fad51722 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:54.715886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1111/2220] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:54.720159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ba1b-b05c-447d-b7be-7f4e058b94fb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:54.730266 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ba1b-b05c-447d-b7be-7f4e058b94fb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:54.734981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b35471-c976-4ae3-aa00-90d874df314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:54.735760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35471-c976-4ae3-aa00-90d874df314e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.736049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35471-c976-4ae3-aa00-90d874df314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.736326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35471-c976-4ae3-aa00-90d874df314e admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.737018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b35471-c976-4ae3-aa00-90d874df314e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:54.738625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b35471-c976-4ae3-aa00-90d874df314e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:54.748661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1110/2221] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:54.752740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140d627-da3c-460e-bdb4-e199fad51722 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:54.763657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140d627-da3c-460e-bdb4-e199fad51722 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:54.768460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:54.769120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.769404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.769681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] PATH_INFO: `/v3/projects/a6a15756104445caa9392e7b261d8bdf/users/a554f78efb24478688305ee6cbe29b44/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.771940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:54.787276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a15756104445caa9392e7b261d8bdf, user_id=a554f78efb24478688305ee6cbe29b44, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:54.790010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:54.804258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1112/2222] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:40:54 2022] PUT /identity/v3/projects/a6a15756104445caa9392e7b261d8bdf/users/a554f78efb24478688305ee6cbe29b44/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:54.816112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652072f5-5069-4d5c-bc10-180c0fcf4b0a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.816400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652072f5-5069-4d5c-bc10-180c0fcf4b0a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.816664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652072f5-5069-4d5c-bc10-180c0fcf4b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:54.846340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-652072f5-5069-4d5c-bc10-180c0fcf4b0a None None] MFA Rules not processed for user `a554f78efb24478688305ee6cbe29b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:54.847591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-652072f5-5069-4d5c-bc10-180c0fcf4b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:54.918906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1111/2223] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:40:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:54.930192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:54.931908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:54.990549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbca42-d09f-4d73-bd22-0bceffcfd46f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:54.994331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe91be-01c9-4ade-ad3f-bae14425b3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:54.994960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe91be-01c9-4ade-ad3f-bae14425b3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:54.995245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe91be-01c9-4ade-ad3f-bae14425b3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:54.995550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe91be-01c9-4ade-ad3f-bae14425b3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:55.005375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe91be-01c9-4ade-ad3f-bae14425b3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:55.006810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe91be-01c9-4ade-ad3f-bae14425b3cd service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:55.016892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1113/2224] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:40:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:41:04.641318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652072f5-5069-4d5c-bc10-180c0fcf4b0a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:41:04.642800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-652072f5-5069-4d5c-bc10-180c0fcf4b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:41:04.666312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:04.707610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652072f5-5069-4d5c-bc10-180c0fcf4b0a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:41:04.711337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1dd50-2897-42e5-ba1f-864fdc955b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:41:04.711990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1dd50-2897-42e5-ba1f-864fdc955b57 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:41:04.712272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1dd50-2897-42e5-ba1f-864fdc955b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:41:04.712547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1dd50-2897-42e5-ba1f-864fdc955b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:41:04.714317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fdc1dd50-2897-42e5-ba1f-864fdc955b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:41:04.783492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1dd50-2897-42e5-ba1f-864fdc955b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:41:04.785110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1dd50-2897-42e5-ba1f-864fdc955b57 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:41:04.795241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1112/2225] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:41:05.012254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:05.123554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe91be-01c9-4ade-ad3f-bae14425b3cd service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:41:05.190345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe91be-01c9-4ade-ad3f-bae14425b3cd service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:41:05.195020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:41:05.195936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:41:05.196221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:41:05.196522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] PATH_INFO: `/v3/users/a554f78efb24478688305ee6cbe29b44` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:41:05.197696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a554f78efb24478688305ee6cbe29b44)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:41:05.200170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:41:05.254629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a554f78efb24478688305ee6cbe29b44'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.265014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a554f78efb24478688305ee6cbe29b44'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.272677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a554f78efb24478688305ee6cbe29b44'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.273354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a554f78efb24478688305ee6cbe29b44'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.287501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a554f78efb24478688305ee6cbe29b44'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.294106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1114/2226] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:41:05 2022] DELETE /identity/v3/users/a554f78efb24478688305ee6cbe29b44 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:41:05.298995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdc35d-7f0a-4d0a-8cf6-33293f80c761 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:41:05.299248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdc35d-7f0a-4d0a-8cf6-33293f80c761 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:41:05.299570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdc35d-7f0a-4d0a-8cf6-33293f80c761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:41:05.319913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-53cdc35d-7f0a-4d0a-8cf6-33293f80c761 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:41:05.321135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-53cdc35d-7f0a-4d0a-8cf6-33293f80c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:41:05.384356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1113/2227] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:41:05.394714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:41:05.396161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:41:05.462029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9dfd1-b162-4e21-892a-fb5b579bf17e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:41:05.468502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07052a2d-a948-4cb8-9332-2efc488b0227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:41:05.469235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052a2d-a948-4cb8-9332-2efc488b0227 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:41:05.469637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052a2d-a948-4cb8-9332-2efc488b0227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:41:05.469981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052a2d-a948-4cb8-9332-2efc488b0227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:41:05.481061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07052a2d-a948-4cb8-9332-2efc488b0227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:41:05.482610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07052a2d-a948-4cb8-9332-2efc488b0227 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:41:05.494133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1115/2228] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:41:05.801688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdc35d-7f0a-4d0a-8cf6-33293f80c761 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:41:05.803366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-53cdc35d-7f0a-4d0a-8cf6-33293f80c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:41:05.818127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdc35d-7f0a-4d0a-8cf6-33293f80c761 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:41:05.824487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:41:05.825427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:41:05.825784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:41:05.826263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] PATH_INFO: `/v3/projects/a6a15756104445caa9392e7b261d8bdf` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:41:05.827803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a15756104445caa9392e7b261d8bdf)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:41:05.829887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:41:05.882304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a15756104445caa9392e7b261d8bdf', 'request_id': 'req-b5fa1e86-bf07-4830-a91e-5987105cd848'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.889428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a15756104445caa9392e7b261d8bdf', 'request_id': 'req-b5fa1e86-bf07-4830-a91e-5987105cd848'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.896025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a15756104445caa9392e7b261d8bdf', 'request_id': 'req-b5fa1e86-bf07-4830-a91e-5987105cd848'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.897854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:05.911821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] The token cache is being invalidate because project a6a15756104445caa9392e7b261d8bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:41:05.912117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.912760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b5fa1e86-bf07-4830-a91e-5987105cd848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:41:05.914355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1114/2229] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:41:05 2022] DELETE /identity/v3/projects/a6a15756104445caa9392e7b261d8bdf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:41:07.997009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ee04-3c93-4ded-9626-c528182c4b29 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:41:07.997486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ee04-3c93-4ded-9626-c528182c4b29 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:41:07.997604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ee04-3c93-4ded-9626-c528182c4b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:41:08.016620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9089ee04-3c93-4ded-9626-c528182c4b29 None None] MFA Rules not processed for user `b325a118b0964730ada2630cd2b47fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:41:08.017825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9089ee04-3c93-4ded-9626-c528182c4b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:41:08.043788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:08.084395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1116/2230] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:41:15.908648 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:18.077739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=15 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:44.076340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbba3a-0738-46d3-b762-13b2db4d327c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:41:44.076846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbba3a-0738-46d3-b762-13b2db4d327c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:41:44.076941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbba3a-0738-46d3-b762-13b2db4d327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:41:44.096197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-89cbba3a-0738-46d3-b762-13b2db4d327c None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:41:44.097403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-89cbba3a-0738-46d3-b762-13b2db4d327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:41:44.151912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1115/2231] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:41:44.198217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ee04-3c93-4ded-9626-c528182c4b29 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:41:44.200226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9089ee04-3c93-4ded-9626-c528182c4b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:41:44.270735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ee04-3c93-4ded-9626-c528182c4b29 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:41:44.275885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db1e05-ca58-4392-9a0f-79b5fec10414 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:41:44.276550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1e05-ca58-4392-9a0f-79b5fec10414 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:41:44.276835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1e05-ca58-4392-9a0f-79b5fec10414 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:41:44.277110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1e05-ca58-4392-9a0f-79b5fec10414 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:41:44.285515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db1e05-ca58-4392-9a0f-79b5fec10414 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:41:44.287104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db1e05-ca58-4392-9a0f-79b5fec10414 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:41:44.295153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1117/2232] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:41:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:41:54.145243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=25 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:54.292071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=32 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:01.987271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2702e-187f-49d0-a698-b16a1a78b9ae None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:01.987869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2702e-187f-49d0-a698-b16a1a78b9ae None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:01.988016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2702e-187f-49d0-a698-b16a1a78b9ae None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:01.989412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1116/2233] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:42:01.996792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0fb16-143a-44d7-8e2d-24bca8fb1e30 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:01.997262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0fb16-143a-44d7-8e2d-24bca8fb1e30 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:01.997262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0fb16-143a-44d7-8e2d-24bca8fb1e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:02.017643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-86e0fb16-143a-44d7-8e2d-24bca8fb1e30 None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:02.018900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-86e0fb16-143a-44d7-8e2d-24bca8fb1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:02.090073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1118/2234] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:02.103496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2702e-187f-49d0-a698-b16a1a78b9ae None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:02.105249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b5c2702e-187f-49d0-a698-b16a1a78b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:02.163643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2702e-187f-49d0-a698-b16a1a78b9ae None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:02.167131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58630262-d5a1-423c-ae53-aa5f9fe360ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03250eb151044619c0f720f315b8509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:02.167780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630262-d5a1-423c-ae53-aa5f9fe360ae service glance] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:02.168059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630262-d5a1-423c-ae53-aa5f9fe360ae service glance] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:02.168330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630262-d5a1-423c-ae53-aa5f9fe360ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:02.178573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58630262-d5a1-423c-ae53-aa5f9fe360ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:02.180037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58630262-d5a1-423c-ae53-aa5f9fe360ae service glance] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:02.190681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1117/2235] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:42:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:02.264999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a3e7-6b2a-46aa-8909-aef401c42c31 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:02.265278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a3e7-6b2a-46aa-8909-aef401c42c31 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:02.265545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a3e7-6b2a-46aa-8909-aef401c42c31 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:02.266896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1119/2236] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:42:02.271488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568d69-758f-4a99-86bb-f1551504a944 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:02.271808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568d69-758f-4a99-86bb-f1551504a944 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:02.272134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568d69-758f-4a99-86bb-f1551504a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:02.292069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3f568d69-758f-4a99-86bb-f1551504a944 None None] MFA Rules not processed for user `1a1f3e1faeba451488854da4236359ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:02.293608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3f568d69-758f-4a99-86bb-f1551504a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:02.344222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1118/2237] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:02.355924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7a3e7-6b2a-46aa-8909-aef401c42c31 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:02.357603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a4b7a3e7-6b2a-46aa-8909-aef401c42c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:02.370510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7a3e7-6b2a-46aa-8909-aef401c42c31 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:02.374613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502009a2-cc60-4f6b-854c-dd21171c9202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:02.375216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502009a2-cc60-4f6b-854c-dd21171c9202 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:02.375539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502009a2-cc60-4f6b-854c-dd21171c9202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:02.375815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502009a2-cc60-4f6b-854c-dd21171c9202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:02.382797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502009a2-cc60-4f6b-854c-dd21171c9202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:02.384259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502009a2-cc60-4f6b-854c-dd21171c9202 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:02.392438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1120/2238] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:42:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:02.477760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f406047-918c-4a84-a150-c479e28e6665 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:02.478072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f406047-918c-4a84-a150-c479e28e6665 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:02.478347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f406047-918c-4a84-a150-c479e28e6665 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:02.479773 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1119/2239] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:42:02.485394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b4e3-8269-4efd-80d2-abe2b0a9f54f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:02.485684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b4e3-8269-4efd-80d2-abe2b0a9f54f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:02.485967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b4e3-8269-4efd-80d2-abe2b0a9f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:02.510093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-15b3b4e3-8269-4efd-80d2-abe2b0a9f54f None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:02.511251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-15b3b4e3-8269-4efd-80d2-abe2b0a9f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:02.521170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1121/2240] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:02.531532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f406047-918c-4a84-a150-c479e28e6665 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:02.542596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f406047-918c-4a84-a150-c479e28e6665 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:02.546441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15bf72-615c-487b-ac02-26d6358daa33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:02.547055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15bf72-615c-487b-ac02-26d6358daa33 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:02.547337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15bf72-615c-487b-ac02-26d6358daa33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:02.547645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15bf72-615c-487b-ac02-26d6358daa33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:02.558188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15bf72-615c-487b-ac02-26d6358daa33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:02.559662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15bf72-615c-487b-ac02-26d6358daa33 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:02.570857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1120/2241] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:42:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:04.985707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0880e-47a4-4c41-a2e8-a9242fc047c8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:04.986152 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0880e-47a4-4c41-a2e8-a9242fc047c8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:04.986285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0880e-47a4-4c41-a2e8-a9242fc047c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:05.006007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-87d0880e-47a4-4c41-a2e8-a9242fc047c8 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:05.007196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87d0880e-47a4-4c41-a2e8-a9242fc047c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:05.014847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1122/2242] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:05.026602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15bf72-615c-487b-ac02-26d6358daa33 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:05.038510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15bf72-615c-487b-ac02-26d6358daa33 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:05.043490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490e036-e431-476b-a88e-baa16de48dd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:05.044102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490e036-e431-476b-a88e-baa16de48dd2 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:05.044406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490e036-e431-476b-a88e-baa16de48dd2 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:05.044814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490e036-e431-476b-a88e-baa16de48dd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:05.053565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490e036-e431-476b-a88e-baa16de48dd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:05.055278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490e036-e431-476b-a88e-baa16de48dd2 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:05.063444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1121/2243] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:42:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:42:15.000666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=43 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:15.060188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=61 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:32.189160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d117-09bc-47e1-a8ea-321d6efadc92 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:32.189625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d117-09bc-47e1-a8ea-321d6efadc92 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:32.189718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d117-09bc-47e1-a8ea-321d6efadc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:32.210680 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1192d117-09bc-47e1-a8ea-321d6efadc92 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:32.211950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1192d117-09bc-47e1-a8ea-321d6efadc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:32.219160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1123/2244] 10.222.0.71 () {58 vars in 967 bytes} [Mon Aug 1 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:32.231638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490e036-e431-476b-a88e-baa16de48dd2 service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:32.243015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490e036-e431-476b-a88e-baa16de48dd2 service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:32.248930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa25f98-e786-40f1-96fb-131d0bf715eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:32.249404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25f98-e786-40f1-96fb-131d0bf715eb service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:32.249688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25f98-e786-40f1-96fb-131d0bf715eb service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:32.249964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25f98-e786-40f1-96fb-131d0bf715eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:32.259352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25f98-e786-40f1-96fb-131d0bf715eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:32.260967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25f98-e786-40f1-96fb-131d0bf715eb service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:32.269081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1122/2245] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:42:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:42:35.416528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192d117-09bc-47e1-a8ea-321d6efadc92 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:35.426087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192d117-09bc-47e1-a8ea-321d6efadc92 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:35.430100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:35.430744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:35.431053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:35.431326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:35.433158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:35.447177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:35.448632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:35.460057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1124/2246] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:42:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:38.976591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa25f98-e786-40f1-96fb-131d0bf715eb service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:38.986759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa25f98-e786-40f1-96fb-131d0bf715eb service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:38.990223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898c1d-33fb-4a4f-9bc0-60649a0dff7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:38.990833 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898c1d-33fb-4a4f-9bc0-60649a0dff7f service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:38.991113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898c1d-33fb-4a4f-9bc0-60649a0dff7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:38.991416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898c1d-33fb-4a4f-9bc0-60649a0dff7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:38.993174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f2898c1d-33fb-4a4f-9bc0-60649a0dff7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:39.007395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2898c1d-33fb-4a4f-9bc0-60649a0dff7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:39.008839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2898c1d-33fb-4a4f-9bc0-60649a0dff7f service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:39.019665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1123/2247] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:42:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:45.455348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=9 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:46.261818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:46.263209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:46.277300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8783fe-8912-451f-bb7a-e80bc64a2093 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:46.283743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:46.284344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:46.284625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:46.284899 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:46.286579 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:46.345430 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:46.347046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:46.356161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1125/2248] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:42:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:47.698619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c349-629d-4022-80a5-f2aa83a174ef None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:47.699263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c349-629d-4022-80a5-f2aa83a174ef None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:47.699263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c349-629d-4022-80a5-f2aa83a174ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:47.724519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-efb5c349-629d-4022-80a5-f2aa83a174ef None None] MFA Rules not processed for user `e4a4c21d432448fcbb75e000741d5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:47.726449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-efb5c349-629d-4022-80a5-f2aa83a174ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:47.736056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1124/2249] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:56.351918 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=28 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:57.717758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=15 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:08.108302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:08.119535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f2820-7caf-4f09-9390-43df069d7874 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:08.125142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:08.125766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:08.126051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:08.126329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:08.128186 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:08.187105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:08.188747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:08.198025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1126/2250] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:18.193619 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=28 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:24.645885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5c349-629d-4022-80a5-f2aa83a174ef None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:24.647409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-efb5c349-629d-4022-80a5-f2aa83a174ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:24.663934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5c349-629d-4022-80a5-f2aa83a174ef None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:24.669346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:24.669946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:24.670226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:24.670498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:24.672294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:24.683658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:24.685497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:24.696641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1125/2251] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:26.431780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:26.433847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:26.445413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd870b-cc88-4936-8f97-3359654dfec2 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:26.449653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae21269-1f8e-4598-aef2-e203091f9c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:26.450263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21269-1f8e-4598-aef2-e203091f9c62 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:26.450549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21269-1f8e-4598-aef2-e203091f9c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:26.450826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21269-1f8e-4598-aef2-e203091f9c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:26.452585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2ae21269-1f8e-4598-aef2-e203091f9c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:26.461847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21269-1f8e-4598-aef2-e203091f9c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:26.463289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21269-1f8e-4598-aef2-e203091f9c62 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:26.471274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1127/2252] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:28.408675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:28.427091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d200bf-8e41-4ca6-af1d-bf0f05b6a13f service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:28.437502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:28.438485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:28.439020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:28.439495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:28.441647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:28.465386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:28.468543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:28.485463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1126/2253] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:36.467801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:38.478287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=12 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:38.785433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d846f9-0e17-4683-9839-1fc908a0ae73 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:38.785931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d846f9-0e17-4683-9839-1fc908a0ae73 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:38.786622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d846f9-0e17-4683-9839-1fc908a0ae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:38.813985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-02d846f9-0e17-4683-9839-1fc908a0ae73 None None] MFA Rules not processed for user `b325a118b0964730ada2630cd2b47fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:43:38.815199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-02d846f9-0e17-4683-9839-1fc908a0ae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:38.822081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1128/2254] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:43:39.128610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:39.137747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872cf15-7ca0-48b5-8be0-6f5733fa09e6 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:39.141292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:39.141903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:39.142506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:39.142785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:39.144546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:39.156109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:39.157535 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:39.165482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1127/2255] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:39.490353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d846f9-0e17-4683-9839-1fc908a0ae73 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:39.491865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-02d846f9-0e17-4683-9839-1fc908a0ae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:39.565142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d846f9-0e17-4683-9839-1fc908a0ae73 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:39.570321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:39.570939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:39.571239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:39.571595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:39.574229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:39.586001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:39.587611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:39.600634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1129/2256] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:43:48.859060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:48.873984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08d1a3-aa4e-4210-b98a-23dfce07c1ac service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:48.880385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:48.881347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:48.881347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:48.883781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:48.883781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:48.905246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:48.911930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:48.933938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1128/2257] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:49.596387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=35 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:49.666045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:49.679409 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c54ff-5392-4ce8-b9ed-a790f2e4a0e4 service placement] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:49.685965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f5a00-2694-431b-8aca-34b37eff1bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:49.686575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5a00-2694-431b-8aca-34b37eff1bb2 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:49.686854 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5a00-2694-431b-8aca-34b37eff1bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:49.687127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5a00-2694-431b-8aca-34b37eff1bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:49.688896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b73f5a00-2694-431b-8aca-34b37eff1bb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:49.747742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f5a00-2694-431b-8aca-34b37eff1bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:49.749343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f5a00-2694-431b-8aca-34b37eff1bb2 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:49.758596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1130/2258] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:53.531321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:53.542708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9695-4f1f-4b50-9887-88eac7bd3c71 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:53.548490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:53.549108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:53.549389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:53.549663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:53.551431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:53.565075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:53.567309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:53.579098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1129/2259] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:59.415598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a51be-0fdf-4179-9efd-8d3feb4ba333 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:59.416089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a51be-0fdf-4179-9efd-8d3feb4ba333 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:59.416183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a51be-0fdf-4179-9efd-8d3feb4ba333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:59.436298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e00a51be-0fdf-4179-9efd-8d3feb4ba333 None None] MFA Rules not processed for user `de3ad14b526247d5b60dc22b88b56255`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:43:59.437503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e00a51be-0fdf-4179-9efd-8d3feb4ba333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:59.444274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1131/2260] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:43:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:43:59.743629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:43:59.753017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2758d-51c2-4cf8-be0a-5a8499fe0a85 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:43:59.756543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:43:59.757147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:43:59.757421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:43:59.757690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:43:59.759398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:43:59.769426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:43:59.770843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:43:59.779316 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1130/2261] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:43:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:09.430797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=31 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:09.775112 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=24 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:23.512896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a51be-0fdf-4179-9efd-8d3feb4ba333 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:23.522408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a51be-0fdf-4179-9efd-8d3feb4ba333 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:23.525947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:23.527180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:23.527485 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:23.527760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:23.529522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:23.590814 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:23.592285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:23.601840 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1132/2262] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:27.008016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:27.010194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:27.023887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156dab6-1687-4c2d-9008-a024fefc646d service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:27.029109 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:27.029744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.030026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.030301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] PATH_INFO: `/v3/users/e4a4c21d432448fcbb75e000741d5dc4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.031491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a4c21d432448fcbb75e000741d5dc4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:27.033416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:27.079542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a4c21d432448fcbb75e000741d5dc4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.086893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a4c21d432448fcbb75e000741d5dc4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.087573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a4c21d432448fcbb75e000741d5dc4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.100166 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a4c21d432448fcbb75e000741d5dc4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.100796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-66c4a40b-9fc9-40a9-b808-98e4b598163b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a4c21d432448fcbb75e000741d5dc4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.114506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1131/2263] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:27 2022] DELETE /identity/v3/users/e4a4c21d432448fcbb75e000741d5dc4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:27.287825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:27.297992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20751862-6740-48e4-becf-0b31883df949 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:27.357689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:27.358329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.358628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.358951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] PATH_INFO: `/v3/projects/4c16b412daae41abb63339c224d44206` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.360149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c16b412daae41abb63339c224d44206)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:27.362099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:27.408396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c16b412daae41abb63339c224d44206', 'request_id': 'req-0865ae36-cf5e-4d67-bca4-09d58a81c93b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.416357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c16b412daae41abb63339c224d44206', 'request_id': 'req-0865ae36-cf5e-4d67-bca4-09d58a81c93b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.423486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c16b412daae41abb63339c224d44206', 'request_id': 'req-0865ae36-cf5e-4d67-bca4-09d58a81c93b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.436416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] The token cache is being invalidate because project 4c16b412daae41abb63339c224d44206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:27.436710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.437422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0865ae36-cf5e-4d67-bca4-09d58a81c93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:27.439022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1133/2264] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:27 2022] DELETE /identity/v3/projects/4c16b412daae41abb63339c224d44206 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:27.444042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4697-f592-46fb-871c-01622a649e0b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.444327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4697-f592-46fb-871c-01622a649e0b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.444599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4697-f592-46fb-871c-01622a649e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.465561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-425e4697-f592-46fb-871c-01622a649e0b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:27.466678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-425e4697-f592-46fb-871c-01622a649e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:27.525460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1132/2265] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:27.533746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9524f46-4911-466e-8df4-3b1722b95120 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.534035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9524f46-4911-466e-8df4-3b1722b95120 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.534344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9524f46-4911-466e-8df4-3b1722b95120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.555158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b9524f46-4911-466e-8df4-3b1722b95120 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:27.556401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b9524f46-4911-466e-8df4-3b1722b95120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:27.564204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1134/2266] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:27.568531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e4697-f592-46fb-871c-01622a649e0b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:27.579192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e4697-f592-46fb-871c-01622a649e0b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:27.584157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:27.584768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.585050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.585354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.586066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:27.586370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:27.588027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:27.600495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1133/2267] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:27.605320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9524f46-4911-466e-8df4-3b1722b95120 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:27.614494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9524f46-4911-466e-8df4-3b1722b95120 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:27.619243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a148e7f-6e14-4fee-884f-baedfcd6181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:27.620514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148e7f-6e14-4fee-884f-baedfcd6181b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.620787 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148e7f-6e14-4fee-884f-baedfcd6181b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.621179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148e7f-6e14-4fee-884f-baedfcd6181b admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.621722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a148e7f-6e14-4fee-884f-baedfcd6181b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:27.623631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a148e7f-6e14-4fee-884f-baedfcd6181b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:27.638622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:27.653779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1135/2268] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:27 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:27.657956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:27.669470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ba93e-f7c1-47cc-9303-f77525552987 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:27.730625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbdbe7-8848-4287-9c85-ff6b8fe5686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:27.730950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdbe7-8848-4287-9c85-ff6b8fe5686b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.731236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdbe7-8848-4287-9c85-ff6b8fe5686b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.731557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdbe7-8848-4287-9c85-ff6b8fe5686b admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.732244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbdbe7-8848-4287-9c85-ff6b8fe5686b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:27.734179 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbdbe7-8848-4287-9c85-ff6b8fe5686b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:27.742275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:27.760573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1134/2269] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:27 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:44:27.764703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a148e7f-6e14-4fee-884f-baedfcd6181b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:27.777246 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a148e7f-6e14-4fee-884f-baedfcd6181b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:27.783526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6a4b8-7167-4cad-bd87-0fd273cc90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:27.784157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6a4b8-7167-4cad-bd87-0fd273cc90be admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.784446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6a4b8-7167-4cad-bd87-0fd273cc90be admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.784716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6a4b8-7167-4cad-bd87-0fd273cc90be admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.785457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6a4b8-7167-4cad-bd87-0fd273cc90be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:27.787111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6a4b8-7167-4cad-bd87-0fd273cc90be admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:27.800940 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1136/2270] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:44:27.805118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbdbe7-8848-4287-9c85-ff6b8fe5686b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:27.816006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbdbe7-8848-4287-9c85-ff6b8fe5686b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:27.820976 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca4f61-0a02-46ee-8dcb-64fd0681a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:27.821605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca4f61-0a02-46ee-8dcb-64fd0681a419 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.822010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca4f61-0a02-46ee-8dcb-64fd0681a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.822368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca4f61-0a02-46ee-8dcb-64fd0681a419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.823130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca4f61-0a02-46ee-8dcb-64fd0681a419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:27.824845 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca4f61-0a02-46ee-8dcb-64fd0681a419 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:27.837061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1135/2271] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:27.841536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6a4b8-7167-4cad-bd87-0fd273cc90be admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:27.856720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6a4b8-7167-4cad-bd87-0fd273cc90be admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:27.861534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3bd05-5fed-4519-93d5-9b865ae93626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:27.862158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3bd05-5fed-4519-93d5-9b865ae93626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.862439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3bd05-5fed-4519-93d5-9b865ae93626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.862714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3bd05-5fed-4519-93d5-9b865ae93626 admin admin] PATH_INFO: `/v3/projects/15bac9ff83474d3b8770632eec8d56b1/users/cf71a96e8b4c49e9bac30d98b48ba253/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.879172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3bd05-5fed-4519-93d5-9b865ae93626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15bac9ff83474d3b8770632eec8d56b1, user_id=cf71a96e8b4c49e9bac30d98b48ba253, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:27.881691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3bd05-5fed-4519-93d5-9b865ae93626 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:27.895759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1137/2272] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:27 2022] PUT /identity/v3/projects/15bac9ff83474d3b8770632eec8d56b1/users/cf71a96e8b4c49e9bac30d98b48ba253/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:27.906525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96165-b290-4f92-bc4c-2ca7bdbf3336 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:27.906840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96165-b290-4f92-bc4c-2ca7bdbf3336 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:27.907100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96165-b290-4f92-bc4c-2ca7bdbf3336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:27.944430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-cfb96165-b290-4f92-bc4c-2ca7bdbf3336 None None] MFA Rules not processed for user `cf71a96e8b4c49e9bac30d98b48ba253`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:27.945704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cfb96165-b290-4f92-bc4c-2ca7bdbf3336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:28.014195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1136/2273] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:28.018734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3bd05-5fed-4519-93d5-9b865ae93626 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:28.085329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3bd05-5fed-4519-93d5-9b865ae93626 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:28.091691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddbafa-5696-4020-9204-d588532143b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:28.092324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbafa-5696-4020-9204-d588532143b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.092610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbafa-5696-4020-9204-d588532143b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.092893 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbafa-5696-4020-9204-d588532143b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.093566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddbafa-5696-4020-9204-d588532143b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:28.096263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddbafa-5696-4020-9204-d588532143b5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:28.126504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1138/2274] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:28 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:28.130778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96165-b290-4f92-bc4c-2ca7bdbf3336 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:28.142662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96165-b290-4f92-bc4c-2ca7bdbf3336 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:28.211132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f666508-204a-4cbc-a61c-65e9d0372fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:28.211790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666508-204a-4cbc-a61c-65e9d0372fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.212071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666508-204a-4cbc-a61c-65e9d0372fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.212344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666508-204a-4cbc-a61c-65e9d0372fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.213018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f666508-204a-4cbc-a61c-65e9d0372fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:28.215534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f666508-204a-4cbc-a61c-65e9d0372fcb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:28.240487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1137/2275] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:28 2022] POST /identity/v3/users => generated 308 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:44:28.241432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddbafa-5696-4020-9204-d588532143b5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:28.252270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddbafa-5696-4020-9204-d588532143b5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:28.256931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc204e-4f79-4fc9-a9a6-048d2db70ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:28.257541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc204e-4f79-4fc9-a9a6-048d2db70ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.257825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc204e-4f79-4fc9-a9a6-048d2db70ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.258103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc204e-4f79-4fc9-a9a6-048d2db70ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.258796 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc204e-4f79-4fc9-a9a6-048d2db70ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:28.261622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc204e-4f79-4fc9-a9a6-048d2db70ff1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:28.272493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1139/2276] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:28.277620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f666508-204a-4cbc-a61c-65e9d0372fcb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:28.287713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f666508-204a-4cbc-a61c-65e9d0372fcb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:28.292391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561f7e3-ac12-4e09-b19e-a69cc29f80f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:28.293045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561f7e3-ac12-4e09-b19e-a69cc29f80f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.293324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561f7e3-ac12-4e09-b19e-a69cc29f80f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.293599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561f7e3-ac12-4e09-b19e-a69cc29f80f1 admin admin] PATH_INFO: `/v3/projects/a7f7297b2e9d48a49244f851f9ec6fcc/users/6f9af1eb7439406fbb86bcae55717e25/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.308749 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561f7e3-ac12-4e09-b19e-a69cc29f80f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f7297b2e9d48a49244f851f9ec6fcc, user_id=6f9af1eb7439406fbb86bcae55717e25, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:28.311497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561f7e3-ac12-4e09-b19e-a69cc29f80f1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:28.324836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1138/2277] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:28 2022] PUT /identity/v3/projects/a7f7297b2e9d48a49244f851f9ec6fcc/users/6f9af1eb7439406fbb86bcae55717e25/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:28.328732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc204e-4f79-4fc9-a9a6-048d2db70ff1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:28.339300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc204e-4f79-4fc9-a9a6-048d2db70ff1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:28.405350 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a0294-2523-42a9-b1cb-b607cdd34530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:28.405969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a0294-2523-42a9-b1cb-b607cdd34530 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.406262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a0294-2523-42a9-b1cb-b607cdd34530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.406532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a0294-2523-42a9-b1cb-b607cdd34530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.407219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a0294-2523-42a9-b1cb-b607cdd34530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:28.408853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a0294-2523-42a9-b1cb-b607cdd34530 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:28.418970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1140/2278] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:28.423164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561f7e3-ac12-4e09-b19e-a69cc29f80f1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:28.434902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561f7e3-ac12-4e09-b19e-a69cc29f80f1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:28.439902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:28.440604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.440913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.441402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] PATH_INFO: `/v3/projects/a7f7297b2e9d48a49244f851f9ec6fcc/users/6f9af1eb7439406fbb86bcae55717e25/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.444867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f7297b2e9d48a49244f851f9ec6fcc, user_id=6f9af1eb7439406fbb86bcae55717e25, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:28.449133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:28.461528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1139/2279] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:28 2022] PUT /identity/v3/projects/a7f7297b2e9d48a49244f851f9ec6fcc/users/6f9af1eb7439406fbb86bcae55717e25/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:28.473059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719654-835c-4ada-b93e-19f4f1836650 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.473366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719654-835c-4ada-b93e-19f4f1836650 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.473635 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719654-835c-4ada-b93e-19f4f1836650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.502265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-73719654-835c-4ada-b93e-19f4f1836650 None None] MFA Rules not processed for user `6f9af1eb7439406fbb86bcae55717e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:28.503487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-73719654-835c-4ada-b93e-19f4f1836650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:28.521922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:28.571387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1141/2280] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:28.582696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:28.584416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:28.607285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:28.645461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f91cb-5948-4696-b59d-312dd50c194f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:28.649184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675f0e8-2b40-4f4a-8c02-2163e14a4af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:28.649831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f0e8-2b40-4f4a-8c02-2163e14a4af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.650235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f0e8-2b40-4f4a-8c02-2163e14a4af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.650486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f0e8-2b40-4f4a-8c02-2163e14a4af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.659715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675f0e8-2b40-4f4a-8c02-2163e14a4af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:28.661168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675f0e8-2b40-4f4a-8c02-2163e14a4af0 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:28.671296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1140/2281] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:28.822075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73719654-835c-4ada-b93e-19f4f1836650 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:28.884150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73719654-835c-4ada-b93e-19f4f1836650 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:28.888987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:28.889624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.889907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.890182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] PATH_INFO: `/v3/users/cf71a96e8b4c49e9bac30d98b48ba253` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:28.891331 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf71a96e8b4c49e9bac30d98b48ba253)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:28.893274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:28.940179 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf71a96e8b4c49e9bac30d98b48ba253'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:28.947264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf71a96e8b4c49e9bac30d98b48ba253'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:28.954360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf71a96e8b4c49e9bac30d98b48ba253'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:28.955062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf71a96e8b4c49e9bac30d98b48ba253'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:28.967484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf71a96e8b4c49e9bac30d98b48ba253'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:28.973304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1142/2282] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:28 2022] DELETE /identity/v3/users/cf71a96e8b4c49e9bac30d98b48ba253 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:28.977933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454aae6-6a22-4e50-8799-5830b3f1a08f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:28.978537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454aae6-6a22-4e50-8799-5830b3f1a08f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:28.978718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454aae6-6a22-4e50-8799-5830b3f1a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:29.000014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0454aae6-6a22-4e50-8799-5830b3f1a08f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:29.001209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0454aae6-6a22-4e50-8799-5830b3f1a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:29.062236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1141/2283] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:29.072572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:29.074099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:29.120449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:29.135439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5de68a-3a0e-4a8d-972c-096907c52cf5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:29.139120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f936c83-63df-4f6b-ab11-d2a6f94a0951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:29.139784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f936c83-63df-4f6b-ab11-d2a6f94a0951 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:29.140074 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f936c83-63df-4f6b-ab11-d2a6f94a0951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:29.140353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f936c83-63df-4f6b-ab11-d2a6f94a0951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:29.149190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f936c83-63df-4f6b-ab11-d2a6f94a0951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:29.150628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f936c83-63df-4f6b-ab11-d2a6f94a0951 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:29.160577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1143/2284] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:29.431121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454aae6-6a22-4e50-8799-5830b3f1a08f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:29.432568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0454aae6-6a22-4e50-8799-5830b3f1a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:29.444411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454aae6-6a22-4e50-8799-5830b3f1a08f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:29.449726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:29.450382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:29.450660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:29.450967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] PATH_INFO: `/v3/projects/15bac9ff83474d3b8770632eec8d56b1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:29.452152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15bac9ff83474d3b8770632eec8d56b1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:29.454066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:29.510968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15bac9ff83474d3b8770632eec8d56b1', 'request_id': 'req-64697d5e-4f5a-47f3-a00b-a008723df4c1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.517323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15bac9ff83474d3b8770632eec8d56b1', 'request_id': 'req-64697d5e-4f5a-47f3-a00b-a008723df4c1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.523016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15bac9ff83474d3b8770632eec8d56b1', 'request_id': 'req-64697d5e-4f5a-47f3-a00b-a008723df4c1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.536506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] The token cache is being invalidate because project 15bac9ff83474d3b8770632eec8d56b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:29.536800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.537424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.538947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1142/2285] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:29 2022] DELETE /identity/v3/projects/15bac9ff83474d3b8770632eec8d56b1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:29.543057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f936c83-63df-4f6b-ab11-d2a6f94a0951 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:29.552740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f936c83-63df-4f6b-ab11-d2a6f94a0951 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:29.609002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:29.609642 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:29.609928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:29.610203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] PATH_INFO: `/v3/users/6f9af1eb7439406fbb86bcae55717e25` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:29.611362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9af1eb7439406fbb86bcae55717e25)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:29.613316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:29.659727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9af1eb7439406fbb86bcae55717e25'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.667103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9af1eb7439406fbb86bcae55717e25'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.675039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9af1eb7439406fbb86bcae55717e25'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.675736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9af1eb7439406fbb86bcae55717e25'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.688463 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6fbec1e-b2b9-4e15-831b-b31175edd5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9af1eb7439406fbb86bcae55717e25'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:29.694311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1144/2286] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:29 2022] DELETE /identity/v3/users/6f9af1eb7439406fbb86bcae55717e25 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:29.975339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:29.977090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:29.990941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697d5e-4f5a-47f3-a00b-a008723df4c1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.037895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:30.053398 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.054307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.054587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.054863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] PATH_INFO: `/v3/projects/a7f7297b2e9d48a49244f851f9ec6fcc` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.056074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f7297b2e9d48a49244f851f9ec6fcc)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.058643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.107919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f7297b2e9d48a49244f851f9ec6fcc', 'request_id': 'req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:30.114815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f7297b2e9d48a49244f851f9ec6fcc', 'request_id': 'req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:30.121460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f7297b2e9d48a49244f851f9ec6fcc', 'request_id': 'req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:30.134434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] The token cache is being invalidate because project a7f7297b2e9d48a49244f851f9ec6fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:30.134730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:30.136045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b006c9f7-0fb7-4e27-b355-3c43a7417ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:30.138094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1143/2287] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:29 2022] DELETE /identity/v3/projects/a7f7297b2e9d48a49244f851f9ec6fcc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:30.143017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c59305-9355-4d11-a9cf-ccd1d6d6f304 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.143303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c59305-9355-4d11-a9cf-ccd1d6d6f304 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.143630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c59305-9355-4d11-a9cf-ccd1d6d6f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.166289 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b3c59305-9355-4d11-a9cf-ccd1d6d6f304 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:30.167614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b3c59305-9355-4d11-a9cf-ccd1d6d6f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:30.226191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:30.247723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1145/2288] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:30.253277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57766c0-5b98-4132-b56b-79d3f9da0b43 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.254565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57766c0-5b98-4132-b56b-79d3f9da0b43 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.254565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57766c0-5b98-4132-b56b-79d3f9da0b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.274922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a57766c0-5b98-4132-b56b-79d3f9da0b43 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:30.276184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a57766c0-5b98-4132-b56b-79d3f9da0b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:30.284039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1144/2289] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:30.288286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c59305-9355-4d11-a9cf-ccd1d6d6f304 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.298488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c59305-9355-4d11-a9cf-ccd1d6d6f304 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.303052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.304031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.304311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.304584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.305274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:30.305576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.307252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.319529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1146/2290] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:30.324046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57766c0-5b98-4132-b56b-79d3f9da0b43 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.333330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57766c0-5b98-4132-b56b-79d3f9da0b43 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.338334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4465a-64b0-47c4-9c7b-00549138dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.338944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4465a-64b0-47c4-9c7b-00549138dd42 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.339228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4465a-64b0-47c4-9c7b-00549138dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.339542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4465a-64b0-47c4-9c7b-00549138dd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.340220 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4465a-64b0-47c4-9c7b-00549138dd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.342138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4465a-64b0-47c4-9c7b-00549138dd42 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.370662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1145/2291] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:30 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:30.375616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.385623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890cd7f-1f49-44cf-872e-bb1c21691779 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.443917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa4d7d-9324-4f22-91de-75a7d9bde3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.444538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa4d7d-9324-4f22-91de-75a7d9bde3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.444822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa4d7d-9324-4f22-91de-75a7d9bde3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.445099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa4d7d-9324-4f22-91de-75a7d9bde3b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.445753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa4d7d-9324-4f22-91de-75a7d9bde3b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.447748 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa4d7d-9324-4f22-91de-75a7d9bde3b9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.469473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1147/2292] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:30 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:30.473717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4465a-64b0-47c4-9c7b-00549138dd42 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.484704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4465a-64b0-47c4-9c7b-00549138dd42 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.489377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c486534-355d-4ab9-91f9-c832ef12978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.489981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c486534-355d-4ab9-91f9-c832ef12978c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.490258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c486534-355d-4ab9-91f9-c832ef12978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.490528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c486534-355d-4ab9-91f9-c832ef12978c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.491219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c486534-355d-4ab9-91f9-c832ef12978c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.492893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c486534-355d-4ab9-91f9-c832ef12978c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.503770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1146/2293] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:30.507946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa4d7d-9324-4f22-91de-75a7d9bde3b9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.517995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa4d7d-9324-4f22-91de-75a7d9bde3b9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.522573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00927e-8149-43f5-9edd-5e6938a0d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.523183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00927e-8149-43f5-9edd-5e6938a0d1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.523497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00927e-8149-43f5-9edd-5e6938a0d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.523772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00927e-8149-43f5-9edd-5e6938a0d1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.524493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00927e-8149-43f5-9edd-5e6938a0d1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.526268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00927e-8149-43f5-9edd-5e6938a0d1b9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.537473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1148/2294] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:30.542444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c486534-355d-4ab9-91f9-c832ef12978c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.552810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c486534-355d-4ab9-91f9-c832ef12978c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.558774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3868df-bec3-410d-aa50-3637f9e68dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.559485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3868df-bec3-410d-aa50-3637f9e68dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.559772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3868df-bec3-410d-aa50-3637f9e68dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.560053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3868df-bec3-410d-aa50-3637f9e68dcf admin admin] PATH_INFO: `/v3/projects/e36714e006b1429fba9b35d65c2f2dab/users/fe3b0cea0a254ebc83453c55baa124fd/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.576635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3868df-bec3-410d-aa50-3637f9e68dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36714e006b1429fba9b35d65c2f2dab, user_id=fe3b0cea0a254ebc83453c55baa124fd, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.579291 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3868df-bec3-410d-aa50-3637f9e68dcf admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.594620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1147/2295] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:30 2022] PUT /identity/v3/projects/e36714e006b1429fba9b35d65c2f2dab/users/fe3b0cea0a254ebc83453c55baa124fd/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:30.606855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0516-bd62-4117-a15b-f015313d8ed9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.607451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0516-bd62-4117-a15b-f015313d8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.607451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0516-bd62-4117-a15b-f015313d8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.636380 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-621e0516-bd62-4117-a15b-f015313d8ed9 None None] MFA Rules not processed for user `fe3b0cea0a254ebc83453c55baa124fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:30.637526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-621e0516-bd62-4117-a15b-f015313d8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:30.701727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1149/2296] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:30.710366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3868df-bec3-410d-aa50-3637f9e68dcf admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.771654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3868df-bec3-410d-aa50-3637f9e68dcf admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.776824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61aaf3-eebe-46a9-bc63-5e236c4cc391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.777437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61aaf3-eebe-46a9-bc63-5e236c4cc391 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.777719 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61aaf3-eebe-46a9-bc63-5e236c4cc391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.777995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61aaf3-eebe-46a9-bc63-5e236c4cc391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.778657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61aaf3-eebe-46a9-bc63-5e236c4cc391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.780603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61aaf3-eebe-46a9-bc63-5e236c4cc391 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.801618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:30.811047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1148/2297] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:30 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:30.815123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e0516-bd62-4117-a15b-f015313d8ed9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.825759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e0516-bd62-4117-a15b-f015313d8ed9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.873792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:30.883549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc206ba6-8a2d-4f10-9d46-16c74ae10767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.884198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206ba6-8a2d-4f10-9d46-16c74ae10767 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.884505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206ba6-8a2d-4f10-9d46-16c74ae10767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.884777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206ba6-8a2d-4f10-9d46-16c74ae10767 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.885481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc206ba6-8a2d-4f10-9d46-16c74ae10767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.887444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc206ba6-8a2d-4f10-9d46-16c74ae10767 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.910982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1150/2298] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:30 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:30.912329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61aaf3-eebe-46a9-bc63-5e236c4cc391 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.923055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61aaf3-eebe-46a9-bc63-5e236c4cc391 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.927697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7f1d-eb2c-4986-9d64-5dba770d5ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.928310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7f1d-eb2c-4986-9d64-5dba770d5ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.928588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7f1d-eb2c-4986-9d64-5dba770d5ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.929116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7f1d-eb2c-4986-9d64-5dba770d5ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.929800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d7f1d-eb2c-4986-9d64-5dba770d5ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.931439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d7f1d-eb2c-4986-9d64-5dba770d5ff8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.941833 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1149/2299] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:44:30.945743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc206ba6-8a2d-4f10-9d46-16c74ae10767 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.955687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc206ba6-8a2d-4f10-9d46-16c74ae10767 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.960333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431732b6-c822-4beb-bc72-7624ee396ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.960937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431732b6-c822-4beb-bc72-7624ee396ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.961223 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431732b6-c822-4beb-bc72-7624ee396ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.961499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431732b6-c822-4beb-bc72-7624ee396ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:30.962196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431732b6-c822-4beb-bc72-7624ee396ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:30.964335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431732b6-c822-4beb-bc72-7624ee396ff9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:30.974122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1151/2300] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:30.978111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7f1d-eb2c-4986-9d64-5dba770d5ff8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:30.988908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7f1d-eb2c-4986-9d64-5dba770d5ff8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:30.993643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8c983-1c2c-4650-9fdc-d7e270995b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:30.994302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c983-1c2c-4650-9fdc-d7e270995b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:30.994588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c983-1c2c-4650-9fdc-d7e270995b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:30.994875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c983-1c2c-4650-9fdc-d7e270995b48 admin admin] PATH_INFO: `/v3/projects/225f2f8d3786422ea436696e397c0d0f/users/d4631bf5fa9a485b91ca9a4948b95034/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.009958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8c983-1c2c-4650-9fdc-d7e270995b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225f2f8d3786422ea436696e397c0d0f, user_id=d4631bf5fa9a485b91ca9a4948b95034, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.013335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8c983-1c2c-4650-9fdc-d7e270995b48 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.025690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1150/2301] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:30 2022] PUT /identity/v3/projects/225f2f8d3786422ea436696e397c0d0f/users/d4631bf5fa9a485b91ca9a4948b95034/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:31.036394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482703f-16a2-4ddd-bf66-db255f99b3df None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.036695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482703f-16a2-4ddd-bf66-db255f99b3df None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.036968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482703f-16a2-4ddd-bf66-db255f99b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.064754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8482703f-16a2-4ddd-bf66-db255f99b3df None None] MFA Rules not processed for user `d4631bf5fa9a485b91ca9a4948b95034`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:31.065969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8482703f-16a2-4ddd-bf66-db255f99b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:31.129051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1152/2302] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:31.133539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8c983-1c2c-4650-9fdc-d7e270995b48 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:31.195713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8c983-1c2c-4650-9fdc-d7e270995b48 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:31.200824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e3d3-fa4e-4616-8363-f0dce010d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:31.201435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e3d3-fa4e-4616-8363-f0dce010d185 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.201716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e3d3-fa4e-4616-8363-f0dce010d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.201991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e3d3-fa4e-4616-8363-f0dce010d185 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.202644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88e3d3-fa4e-4616-8363-f0dce010d185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.204584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88e3d3-fa4e-4616-8363-f0dce010d185 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.234798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1151/2303] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:31 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:31.236235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482703f-16a2-4ddd-bf66-db255f99b3df None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:31.246994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482703f-16a2-4ddd-bf66-db255f99b3df None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:31.302238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1757-2c01-486d-bea6-aa17b1c82595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:31.302851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1757-2c01-486d-bea6-aa17b1c82595 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.303131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1757-2c01-486d-bea6-aa17b1c82595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.303423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1757-2c01-486d-bea6-aa17b1c82595 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.304345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1757-2c01-486d-bea6-aa17b1c82595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.306256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1757-2c01-486d-bea6-aa17b1c82595 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.328779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1153/2304] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:31 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:31.332792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e3d3-fa4e-4616-8363-f0dce010d185 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:31.344057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e3d3-fa4e-4616-8363-f0dce010d185 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:31.348801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee6d4d-c16b-45f1-a24a-7c7a41b561b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:31.349421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6d4d-c16b-45f1-a24a-7c7a41b561b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.349795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6d4d-c16b-45f1-a24a-7c7a41b561b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.350048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6d4d-c16b-45f1-a24a-7c7a41b561b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.350659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee6d4d-c16b-45f1-a24a-7c7a41b561b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.352304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee6d4d-c16b-45f1-a24a-7c7a41b561b9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.372655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1152/2305] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:44:31.377032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1757-2c01-486d-bea6-aa17b1c82595 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:31.387828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1757-2c01-486d-bea6-aa17b1c82595 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:31.393480 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473c086-2592-4fe2-8e6f-ffa00e636bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:31.394164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473c086-2592-4fe2-8e6f-ffa00e636bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.394455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473c086-2592-4fe2-8e6f-ffa00e636bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.394731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473c086-2592-4fe2-8e6f-ffa00e636bfc admin admin] PATH_INFO: `/v3/projects/76c4761ff26340b4822e39a17f92387a/users/46bb7d45d6b642f79ae96a9869a92d75/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.410205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473c086-2592-4fe2-8e6f-ffa00e636bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c4761ff26340b4822e39a17f92387a, user_id=46bb7d45d6b642f79ae96a9869a92d75, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.412906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473c086-2592-4fe2-8e6f-ffa00e636bfc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.426809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1154/2306] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:31 2022] PUT /identity/v3/projects/76c4761ff26340b4822e39a17f92387a/users/46bb7d45d6b642f79ae96a9869a92d75/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:31.431132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee6d4d-c16b-45f1-a24a-7c7a41b561b9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:31.442867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee6d4d-c16b-45f1-a24a-7c7a41b561b9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:31.504829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60394f-859b-4f57-85ba-2a89454070fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:31.505565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60394f-859b-4f57-85ba-2a89454070fd admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.505857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60394f-859b-4f57-85ba-2a89454070fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.506163 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60394f-859b-4f57-85ba-2a89454070fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.506885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60394f-859b-4f57-85ba-2a89454070fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.508556 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60394f-859b-4f57-85ba-2a89454070fd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.519985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1153/2307] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:31.524170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473c086-2592-4fe2-8e6f-ffa00e636bfc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:31.534669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473c086-2592-4fe2-8e6f-ffa00e636bfc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:31.539486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb08996-8320-42a8-b870-e551bbb7454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:31.540257 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08996-8320-42a8-b870-e551bbb7454a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.541611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08996-8320-42a8-b870-e551bbb7454a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.541611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08996-8320-42a8-b870-e551bbb7454a admin admin] PATH_INFO: `/v3/projects/76c4761ff26340b4822e39a17f92387a/users/46bb7d45d6b642f79ae96a9869a92d75/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.543144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb08996-8320-42a8-b870-e551bbb7454a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c4761ff26340b4822e39a17f92387a, user_id=46bb7d45d6b642f79ae96a9869a92d75, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.545844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb08996-8320-42a8-b870-e551bbb7454a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.556972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1155/2308] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:31 2022] PUT /identity/v3/projects/76c4761ff26340b4822e39a17f92387a/users/46bb7d45d6b642f79ae96a9869a92d75/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:31.568586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c474a8-ff1b-4319-9f72-6e1b79518f39 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.568958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c474a8-ff1b-4319-9f72-6e1b79518f39 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.569311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c474a8-ff1b-4319-9f72-6e1b79518f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.600204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-66c474a8-ff1b-4319-9f72-6e1b79518f39 None None] MFA Rules not processed for user `46bb7d45d6b642f79ae96a9869a92d75`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:31.601438 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-66c474a8-ff1b-4319-9f72-6e1b79518f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:31.623466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:31.668336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148dce-7c69-4ad5-b45c-95dee3692456 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.668957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148dce-7c69-4ad5-b45c-95dee3692456 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.668957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148dce-7c69-4ad5-b45c-95dee3692456 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.670220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1156/2309] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:44:31.676216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a13ab-673e-42bf-b009-79a3ff0aaae0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.676607 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a13ab-673e-42bf-b009-79a3ff0aaae0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.676947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a13ab-673e-42bf-b009-79a3ff0aaae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.687853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1154/2310] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:31.699701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c474a8-ff1b-4319-9f72-6e1b79518f39 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:31.701114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-66c474a8-ff1b-4319-9f72-6e1b79518f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:31.703920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ef6a13ab-673e-42bf-b009-79a3ff0aaae0 None None] MFA Rules not processed for user `1a1f3e1faeba451488854da4236359ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:31.705109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ef6a13ab-673e-42bf-b009-79a3ff0aaae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:31.714367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:31.768882 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1157/2311] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:31.773468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c474a8-ff1b-4319-9f72-6e1b79518f39 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:31.777522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70578ad2-b120-4e20-8c35-205474eb74bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:31.778156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70578ad2-b120-4e20-8c35-205474eb74bf service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.778439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70578ad2-b120-4e20-8c35-205474eb74bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.778716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70578ad2-b120-4e20-8c35-205474eb74bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.782128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a13ab-673e-42bf-b009-79a3ff0aaae0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:31.783629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ef6a13ab-673e-42bf-b009-79a3ff0aaae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:31.795645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70578ad2-b120-4e20-8c35-205474eb74bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.796708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a13ab-673e-42bf-b009-79a3ff0aaae0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:31.797150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70578ad2-b120-4e20-8c35-205474eb74bf service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.806306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d12af-9305-4e3e-ab64-79da009f07c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:31.806306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d12af-9305-4e3e-ab64-79da009f07c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.806306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d12af-9305-4e3e-ab64-79da009f07c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.806306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d12af-9305-4e3e-ab64-79da009f07c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.813690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1155/2312] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:44:31.817609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d12af-9305-4e3e-ab64-79da009f07c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:31.819054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d12af-9305-4e3e-ab64-79da009f07c9 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:31.827445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1158/2313] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:44:31.921969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd807c4-e91f-4b0d-b4aa-5e220e8048f9 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.922262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd807c4-e91f-4b0d-b4aa-5e220e8048f9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.922539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd807c4-e91f-4b0d-b4aa-5e220e8048f9 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.923939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1156/2314] 10.222.0.71 () {54 vars in 921 bytes} [Mon Aug 1 15:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:44:31.930012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaa4bf-2c51-43a3-9a33-16c628183bf2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:31.930298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaa4bf-2c51-43a3-9a33-16c628183bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:31.930570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaa4bf-2c51-43a3-9a33-16c628183bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:31.953865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-90eaa4bf-2c51-43a3-9a33-16c628183bf2 None None] MFA Rules not processed for user `4aa7374d435f497d9e9bdd3c5d9d2c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:31.955081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-90eaa4bf-2c51-43a3-9a33-16c628183bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:32.026094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1159/2315] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Aug 1 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:32.040536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd807c4-e91f-4b0d-b4aa-5e220e8048f9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:32.052493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd807c4-e91f-4b0d-b4aa-5e220e8048f9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:32.056618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926fd99-12d0-4964-a6fb-7ef316b783da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:32.057969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926fd99-12d0-4964-a6fb-7ef316b783da service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:32.058259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926fd99-12d0-4964-a6fb-7ef316b783da service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:32.058539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926fd99-12d0-4964-a6fb-7ef316b783da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:32.069503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926fd99-12d0-4964-a6fb-7ef316b783da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:32.071001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926fd99-12d0-4964-a6fb-7ef316b783da service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:32.082365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1157/2316] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:32.348788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaa4bf-2c51-43a3-9a33-16c628183bf2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:32.350277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-90eaa4bf-2c51-43a3-9a33-16c628183bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:32.362428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaa4bf-2c51-43a3-9a33-16c628183bf2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:32.365980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df043d-2c31-48e0-b79f-816d704a0243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:32.366585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df043d-2c31-48e0-b79f-816d704a0243 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:32.366865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df043d-2c31-48e0-b79f-816d704a0243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:32.367301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df043d-2c31-48e0-b79f-816d704a0243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:32.431654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df043d-2c31-48e0-b79f-816d704a0243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:32.433504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df043d-2c31-48e0-b79f-816d704a0243 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:32.444110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1160/2317] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:36.496107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926fd99-12d0-4964-a6fb-7ef316b783da service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.505306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926fd99-12d0-4964-a6fb-7ef316b783da service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.508853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8d1a6-5e04-4038-89ff-fe38635e64b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.509465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8d1a6-5e04-4038-89ff-fe38635e64b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.509794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8d1a6-5e04-4038-89ff-fe38635e64b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.510077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8d1a6-5e04-4038-89ff-fe38635e64b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.567778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8d1a6-5e04-4038-89ff-fe38635e64b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.569213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8d1a6-5e04-4038-89ff-fe38635e64b8 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.577975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1158/2318] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:44:38.677487 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df043d-2c31-48e0-b79f-816d704a0243 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.724094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:38.744862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df043d-2c31-48e0-b79f-816d704a0243 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.749411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.750054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.750334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.750605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] PATH_INFO: `/v3/users/fe3b0cea0a254ebc83453c55baa124fd` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.751792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3b0cea0a254ebc83453c55baa124fd)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.753693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.804628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3b0cea0a254ebc83453c55baa124fd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:38.816689 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3b0cea0a254ebc83453c55baa124fd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:38.824467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3b0cea0a254ebc83453c55baa124fd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:38.825123 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3b0cea0a254ebc83453c55baa124fd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:38.837924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3b0cea0a254ebc83453c55baa124fd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:38.844855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1161/2319] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:38 2022] DELETE /identity/v3/users/fe3b0cea0a254ebc83453c55baa124fd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:38.849318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c036-7a0f-402e-b5b1-df272d6692f3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.849791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c036-7a0f-402e-b5b1-df272d6692f3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.849885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c036-7a0f-402e-b5b1-df272d6692f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.873686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e473c036-7a0f-402e-b5b1-df272d6692f3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:38.874886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e473c036-7a0f-402e-b5b1-df272d6692f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:38.926295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:38.944869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1159/2320] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:38.955452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.957053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:39.016327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea7652-23a8-4ff4-bfd2-6451d2d94839 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.019968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b14b-e944-4c79-bbf3-3ec1d10d115f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.020585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b14b-e944-4c79-bbf3-3ec1d10d115f service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.020866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b14b-e944-4c79-bbf3-3ec1d10d115f service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.021141 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b14b-e944-4c79-bbf3-3ec1d10d115f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.031272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b14b-e944-4c79-bbf3-3ec1d10d115f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.032722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b14b-e944-4c79-bbf3-3ec1d10d115f service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.042856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1162/2321] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:39.567065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473c036-7a0f-402e-b5b1-df272d6692f3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.568523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e473c036-7a0f-402e-b5b1-df272d6692f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:39.581065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473c036-7a0f-402e-b5b1-df272d6692f3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.585817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.586467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.586943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.587081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] PATH_INFO: `/v3/projects/e36714e006b1429fba9b35d65c2f2dab` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.588544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36714e006b1429fba9b35d65c2f2dab)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.590517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.642055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36714e006b1429fba9b35d65c2f2dab', 'request_id': 'req-7da57086-b147-4656-b7e0-8a4bc9149187'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.648608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36714e006b1429fba9b35d65c2f2dab', 'request_id': 'req-7da57086-b147-4656-b7e0-8a4bc9149187'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.654867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36714e006b1429fba9b35d65c2f2dab', 'request_id': 'req-7da57086-b147-4656-b7e0-8a4bc9149187'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.669010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] The token cache is being invalidate because project e36714e006b1429fba9b35d65c2f2dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:39.669303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.669933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.672026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1160/2322] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:39 2022] DELETE /identity/v3/projects/e36714e006b1429fba9b35d65c2f2dab => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:39.675983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b14b-e944-4c79-bbf3-3ec1d10d115f service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.691169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b14b-e944-4c79-bbf3-3ec1d10d115f service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.749352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.749999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.750277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.750604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] PATH_INFO: `/v3/users/d4631bf5fa9a485b91ca9a4948b95034` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.751768 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4631bf5fa9a485b91ca9a4948b95034)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.753711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.756375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:39.805527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4631bf5fa9a485b91ca9a4948b95034'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.814959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4631bf5fa9a485b91ca9a4948b95034'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.822268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4631bf5fa9a485b91ca9a4948b95034'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.823527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4631bf5fa9a485b91ca9a4948b95034'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.835914 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4631bf5fa9a485b91ca9a4948b95034'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:39.842720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1163/2323] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:39 2022] DELETE /identity/v3/users/d4631bf5fa9a485b91ca9a4948b95034 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:40.165167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:40.167275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:40.180333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57086-b147-4656-b7e0-8a4bc9149187 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:40.244519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:40.245676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.245958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.246236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] PATH_INFO: `/v3/projects/225f2f8d3786422ea436696e397c0d0f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.247466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=225f2f8d3786422ea436696e397c0d0f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:40.249397 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:40.298729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225f2f8d3786422ea436696e397c0d0f', 'request_id': 'req-654adc14-e5e8-4a69-a438-10a048c8a352'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.305614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225f2f8d3786422ea436696e397c0d0f', 'request_id': 'req-654adc14-e5e8-4a69-a438-10a048c8a352'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.311706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225f2f8d3786422ea436696e397c0d0f', 'request_id': 'req-654adc14-e5e8-4a69-a438-10a048c8a352'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.320589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:40.325113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] The token cache is being invalidate because project 225f2f8d3786422ea436696e397c0d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:40.325604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.326940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.329269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1161/2324] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:40 2022] DELETE /identity/v3/projects/225f2f8d3786422ea436696e397c0d0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:40.333148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:40.334565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:40.347029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733b74-c6b7-4bab-9d4d-e858d004d13a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:40.406451 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:40.407098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.407392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.407687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] PATH_INFO: `/v3/users/46bb7d45d6b642f79ae96a9869a92d75` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.408843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bb7d45d6b642f79ae96a9869a92d75)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:40.410775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:40.457592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bb7d45d6b642f79ae96a9869a92d75'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.468388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bb7d45d6b642f79ae96a9869a92d75'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.475789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bb7d45d6b642f79ae96a9869a92d75'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.476415 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bb7d45d6b642f79ae96a9869a92d75'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.488671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-af3b66dc-768c-479c-aa1f-ccb35e3922c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bb7d45d6b642f79ae96a9869a92d75'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.490955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:40.495570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1164/2325] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:40 2022] DELETE /identity/v3/users/46bb7d45d6b642f79ae96a9869a92d75 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:40.775541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:40.778160 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:40.791361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654adc14-e5e8-4a69-a438-10a048c8a352 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:40.852042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:40.852600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.852878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.853149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] PATH_INFO: `/v3/projects/76c4761ff26340b4822e39a17f92387a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.854300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c4761ff26340b4822e39a17f92387a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:40.856435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:40.908444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c4761ff26340b4822e39a17f92387a', 'request_id': 'req-731dd79c-7e12-4a83-b588-32811b4d40ed'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.914886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c4761ff26340b4822e39a17f92387a', 'request_id': 'req-731dd79c-7e12-4a83-b588-32811b4d40ed'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.920894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c4761ff26340b4822e39a17f92387a', 'request_id': 'req-731dd79c-7e12-4a83-b588-32811b4d40ed'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.934504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] The token cache is being invalidate because project 76c4761ff26340b4822e39a17f92387a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:40.934800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.935469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-731dd79c-7e12-4a83-b588-32811b4d40ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:40.939182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1162/2326] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:40 2022] DELETE /identity/v3/projects/76c4761ff26340b4822e39a17f92387a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:40.943072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83c2e-9f89-416e-aa3b-81a2a474c0bb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.943600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83c2e-9f89-416e-aa3b-81a2a474c0bb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.943714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83c2e-9f89-416e-aa3b-81a2a474c0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.966004 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2ef83c2e-9f89-416e-aa3b-81a2a474c0bb None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:40.967231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2ef83c2e-9f89-416e-aa3b-81a2a474c0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:41.032907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1165/2327] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:41.043341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff567-2db6-4b41-b209-942c71652c2e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.043665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff567-2db6-4b41-b209-942c71652c2e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.043952 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff567-2db6-4b41-b209-942c71652c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.064934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a5aff567-2db6-4b41-b209-942c71652c2e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:41.066164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a5aff567-2db6-4b41-b209-942c71652c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:41.076108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1163/2328] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:41.080473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef83c2e-9f89-416e-aa3b-81a2a474c0bb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.091712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef83c2e-9f89-416e-aa3b-81a2a474c0bb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.096663 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.097313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.097594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.097862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.098563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:41.098853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.101171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.113585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1166/2329] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:41.117716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff567-2db6-4b41-b209-942c71652c2e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.129476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff567-2db6-4b41-b209-942c71652c2e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.132754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09425084-fc1c-4b61-bd8b-c855e21e194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.133469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09425084-fc1c-4b61-bd8b-c855e21e194c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.133896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09425084-fc1c-4b61-bd8b-c855e21e194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.134816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09425084-fc1c-4b61-bd8b-c855e21e194c admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.135212 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09425084-fc1c-4b61-bd8b-c855e21e194c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.137830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09425084-fc1c-4b61-bd8b-c855e21e194c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.176357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1164/2330] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:41 2022] POST /identity/v3/projects => generated 409 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:41.180614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.193122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58a14-595d-46ba-bdb4-243e8b7c9ad2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.261690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baa2c0-d259-4f90-8611-cf1808023210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.262351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa2c0-d259-4f90-8611-cf1808023210 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.262634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa2c0-d259-4f90-8611-cf1808023210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.262913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa2c0-d259-4f90-8611-cf1808023210 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.263631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baa2c0-d259-4f90-8611-cf1808023210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.265807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baa2c0-d259-4f90-8611-cf1808023210 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.300498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1167/2331] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:41 2022] POST /identity/v3/users => generated 305 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:41.304917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09425084-fc1c-4b61-bd8b-c855e21e194c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.316449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09425084-fc1c-4b61-bd8b-c855e21e194c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.321247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0b262-1ab8-4126-81e3-42f2e57a7a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.321878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0b262-1ab8-4126-81e3-42f2e57a7a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.322155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0b262-1ab8-4126-81e3-42f2e57a7a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.322433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0b262-1ab8-4126-81e3-42f2e57a7a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.324025 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0b262-1ab8-4126-81e3-42f2e57a7a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.325651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0b262-1ab8-4126-81e3-42f2e57a7a45 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.336475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1165/2332] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:41.340802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baa2c0-d259-4f90-8611-cf1808023210 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.351587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baa2c0-d259-4f90-8611-cf1808023210 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.357523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a3ed-dcf1-48ca-9e62-d8bd48ec03c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.358776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a3ed-dcf1-48ca-9e62-d8bd48ec03c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.358776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a3ed-dcf1-48ca-9e62-d8bd48ec03c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.358776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a3ed-dcf1-48ca-9e62-d8bd48ec03c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.359989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a3ed-dcf1-48ca-9e62-d8bd48ec03c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.361078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a3ed-dcf1-48ca-9e62-d8bd48ec03c5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.373428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1168/2333] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:41.378263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0b262-1ab8-4126-81e3-42f2e57a7a45 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.391740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0b262-1ab8-4126-81e3-42f2e57a7a45 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.397039 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbfd79-d428-43a8-91b1-c86986251db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.397703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbfd79-d428-43a8-91b1-c86986251db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.397985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbfd79-d428-43a8-91b1-c86986251db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.398261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbfd79-d428-43a8-91b1-c86986251db2 admin admin] PATH_INFO: `/v3/projects/6aa61995dc044109a833150da9b191ae/users/45942476387d4d359502ebd8d0b40920/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.415539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbfd79-d428-43a8-91b1-c86986251db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa61995dc044109a833150da9b191ae, user_id=45942476387d4d359502ebd8d0b40920, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.418805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbfd79-d428-43a8-91b1-c86986251db2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.434920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1166/2334] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:41 2022] PUT /identity/v3/projects/6aa61995dc044109a833150da9b191ae/users/45942476387d4d359502ebd8d0b40920/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:41.446633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85e55-dadc-4e59-ac5f-f9a440bbabd9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.446903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85e55-dadc-4e59-ac5f-f9a440bbabd9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.447178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85e55-dadc-4e59-ac5f-f9a440bbabd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.477150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0fa85e55-dadc-4e59-ac5f-f9a440bbabd9 None None] MFA Rules not processed for user `45942476387d4d359502ebd8d0b40920`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:41.478556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0fa85e55-dadc-4e59-ac5f-f9a440bbabd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:41.540912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:41.551861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1169/2335] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:41.556403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbfd79-d428-43a8-91b1-c86986251db2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.587904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:41.622388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbfd79-d428-43a8-91b1-c86986251db2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.632737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21543ca-fd02-4446-bed0-0f1b0024efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.633303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21543ca-fd02-4446-bed0-0f1b0024efbd admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.633588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21543ca-fd02-4446-bed0-0f1b0024efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.633865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21543ca-fd02-4446-bed0-0f1b0024efbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.636113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21543ca-fd02-4446-bed0-0f1b0024efbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.637786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21543ca-fd02-4446-bed0-0f1b0024efbd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.666536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1167/2336] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:41 2022] POST /identity/v3/projects => generated 409 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:41.670423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa85e55-dadc-4e59-ac5f-f9a440bbabd9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.682027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa85e55-dadc-4e59-ac5f-f9a440bbabd9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.745107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a152704-53f0-4e0b-a8ee-4b24e75a0a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.745751 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a152704-53f0-4e0b-a8ee-4b24e75a0a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.746035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a152704-53f0-4e0b-a8ee-4b24e75a0a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.746311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a152704-53f0-4e0b-a8ee-4b24e75a0a2f admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.747077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a152704-53f0-4e0b-a8ee-4b24e75a0a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.748956 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a152704-53f0-4e0b-a8ee-4b24e75a0a2f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.774721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1170/2337] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:41 2022] POST /identity/v3/users => generated 311 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:41.779431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21543ca-fd02-4446-bed0-0f1b0024efbd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.792543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21543ca-fd02-4446-bed0-0f1b0024efbd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.798318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f04ede-d1c5-4695-b7f4-6fd797e8ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.799047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f04ede-d1c5-4695-b7f4-6fd797e8ab61 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.799334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f04ede-d1c5-4695-b7f4-6fd797e8ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.799697 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f04ede-d1c5-4695-b7f4-6fd797e8ab61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.800362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f04ede-d1c5-4695-b7f4-6fd797e8ab61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.802250 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f04ede-d1c5-4695-b7f4-6fd797e8ab61 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.815642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1168/2338] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:44:41.819552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a152704-53f0-4e0b-a8ee-4b24e75a0a2f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.831180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a152704-53f0-4e0b-a8ee-4b24e75a0a2f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.836039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47e7f-2c04-478d-8f7b-6bea91f34e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.836715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47e7f-2c04-478d-8f7b-6bea91f34e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.837005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47e7f-2c04-478d-8f7b-6bea91f34e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.837285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47e7f-2c04-478d-8f7b-6bea91f34e2d admin admin] PATH_INFO: `/v3/projects/2ce289d1fec7430eb7ebc19fe21fd526/users/05565736e4b1479f89db6e645a158020/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.855354 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47e7f-2c04-478d-8f7b-6bea91f34e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce289d1fec7430eb7ebc19fe21fd526, user_id=05565736e4b1479f89db6e645a158020, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.858118 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47e7f-2c04-478d-8f7b-6bea91f34e2d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.880344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1171/2339] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:41 2022] PUT /identity/v3/projects/2ce289d1fec7430eb7ebc19fe21fd526/users/05565736e4b1479f89db6e645a158020/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:41.884386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f04ede-d1c5-4695-b7f4-6fd797e8ab61 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.897023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f04ede-d1c5-4695-b7f4-6fd797e8ab61 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.963567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc5ac2-3706-4801-90b0-ad0dd68792a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.964659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5ac2-3706-4801-90b0-ad0dd68792a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.965159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5ac2-3706-4801-90b0-ad0dd68792a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.965428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5ac2-3706-4801-90b0-ad0dd68792a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.966216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc5ac2-3706-4801-90b0-ad0dd68792a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.967933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc5ac2-3706-4801-90b0-ad0dd68792a3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.982323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1169/2340] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:41.983500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47e7f-2c04-478d-8f7b-6bea91f34e2d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.994251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47e7f-2c04-478d-8f7b-6bea91f34e2d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:42.000850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:42.001805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:42.003537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:42.003850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] PATH_INFO: `/v3/projects/2ce289d1fec7430eb7ebc19fe21fd526/users/05565736e4b1479f89db6e645a158020/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:42.006011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce289d1fec7430eb7ebc19fe21fd526, user_id=05565736e4b1479f89db6e645a158020, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:42.008732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:42.021633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1172/2341] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:41 2022] PUT /identity/v3/projects/2ce289d1fec7430eb7ebc19fe21fd526/users/05565736e4b1479f89db6e645a158020/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:42.033262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c8fa-5cb0-47d4-a91b-a5e6f74fee46 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:42.033601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c8fa-5cb0-47d4-a91b-a5e6f74fee46 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:42.033884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c8fa-5cb0-47d4-a91b-a5e6f74fee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:42.063745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b9e0c8fa-5cb0-47d4-a91b-a5e6f74fee46 None None] MFA Rules not processed for user `05565736e4b1479f89db6e645a158020`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:42.064964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b9e0c8fa-5cb0-47d4-a91b-a5e6f74fee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:42.137026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1170/2342] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:42.148612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:42.150486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:42.210500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d4e7-f9d9-466a-b7c4-0e85f4b9caa0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:42.214235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec07c78-ba94-490f-a59d-f449fe5dcbd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:42.214862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07c78-ba94-490f-a59d-f449fe5dcbd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:42.215144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07c78-ba94-490f-a59d-f449fe5dcbd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:42.215445 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07c78-ba94-490f-a59d-f449fe5dcbd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:42.224402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec07c78-ba94-490f-a59d-f449fe5dcbd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:42.225832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec07c78-ba94-490f-a59d-f449fe5dcbd9 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:42.236740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1173/2343] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:42.389865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0c8fa-5cb0-47d4-a91b-a5e6f74fee46 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:42.400574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0c8fa-5cb0-47d4-a91b-a5e6f74fee46 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:42.404347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4b0a1-fe5d-4c90-831f-8a48561cf1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:42.404971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4b0a1-fe5d-4c90-831f-8a48561cf1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:42.405248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4b0a1-fe5d-4c90-831f-8a48561cf1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:42.405528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4b0a1-fe5d-4c90-831f-8a48561cf1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:42.426489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:42.470304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4b0a1-fe5d-4c90-831f-8a48561cf1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:42.471806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4b0a1-fe5d-4c90-831f-8a48561cf1b9 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:42.481615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1171/2344] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:47.861114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec07c78-ba94-490f-a59d-f449fe5dcbd9 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:47.915621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:47.930274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec07c78-ba94-490f-a59d-f449fe5dcbd9 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:47.935932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:47.936723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:47.937016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:47.937428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] PATH_INFO: `/v3/users/45942476387d4d359502ebd8d0b40920` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:47.938782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45942476387d4d359502ebd8d0b40920)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:47.941038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:47.988896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45942476387d4d359502ebd8d0b40920'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.998435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45942476387d4d359502ebd8d0b40920'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.006791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45942476387d4d359502ebd8d0b40920'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.007604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45942476387d4d359502ebd8d0b40920'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.020637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45942476387d4d359502ebd8d0b40920'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.027041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1174/2345] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:47 2022] DELETE /identity/v3/users/45942476387d4d359502ebd8d0b40920 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:48.031616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8a907-c05c-4e9e-af0a-77d597c2844e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:48.032083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8a907-c05c-4e9e-af0a-77d597c2844e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:48.032191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8a907-c05c-4e9e-af0a-77d597c2844e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:48.051955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-bba8a907-c05c-4e9e-af0a-77d597c2844e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:48.053187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bba8a907-c05c-4e9e-af0a-77d597c2844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:48.116917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1172/2346] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:48.127202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:48.128750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:48.190817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b83ce7-3a3c-4fd3-b80c-5eb57905c919 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:48.194413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f0e07-8dbe-4646-a0dd-5d595f691139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:48.195040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0e07-8dbe-4646-a0dd-5d595f691139 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:48.195323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0e07-8dbe-4646-a0dd-5d595f691139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:48.195631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0e07-8dbe-4646-a0dd-5d595f691139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:48.205407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f0e07-8dbe-4646-a0dd-5d595f691139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:48.206850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f0e07-8dbe-4646-a0dd-5d595f691139 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:48.216447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1175/2347] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:48.648784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8a907-c05c-4e9e-af0a-77d597c2844e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:48.650287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bba8a907-c05c-4e9e-af0a-77d597c2844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:48.665232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8a907-c05c-4e9e-af0a-77d597c2844e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:48.671089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:48.671513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:48.671863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:48.672206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] PATH_INFO: `/v3/projects/6aa61995dc044109a833150da9b191ae` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:48.673448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa61995dc044109a833150da9b191ae)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:48.675475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:48.727329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa61995dc044109a833150da9b191ae', 'request_id': 'req-19a7b4cc-7982-49d4-ac63-d4c411e1b481'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.735354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa61995dc044109a833150da9b191ae', 'request_id': 'req-19a7b4cc-7982-49d4-ac63-d4c411e1b481'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.742189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa61995dc044109a833150da9b191ae', 'request_id': 'req-19a7b4cc-7982-49d4-ac63-d4c411e1b481'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.755144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] The token cache is being invalidate because project 6aa61995dc044109a833150da9b191ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:48.755468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.756095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-19a7b4cc-7982-49d4-ac63-d4c411e1b481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.757647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1173/2348] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:48 2022] DELETE /identity/v3/projects/6aa61995dc044109a833150da9b191ae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:48.761721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f0e07-8dbe-4646-a0dd-5d595f691139 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:48.771639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f0e07-8dbe-4646-a0dd-5d595f691139 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:48.832986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18e99-1809-4426-869e-fe00c459c6b6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:48.833280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18e99-1809-4426-869e-fe00c459c6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:48.833559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18e99-1809-4426-869e-fe00c459c6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:48.836711 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:48.837598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:48.837949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:48.838818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] PATH_INFO: `/v3/users/05565736e4b1479f89db6e645a158020` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:48.840131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05565736e4b1479f89db6e645a158020)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:48.842499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:48.854959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a7b18e99-1809-4426-869e-fe00c459c6b6 None None] MFA Rules not processed for user `f4fa2b7534d0498f9e30c382e640c878`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:48.856483 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a7b18e99-1809-4426-869e-fe00c459c6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:48.858294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:48.894831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05565736e4b1479f89db6e645a158020'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.897667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:48.903938 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05565736e4b1479f89db6e645a158020'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.911728 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05565736e4b1479f89db6e645a158020'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.912390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05565736e4b1479f89db6e645a158020'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.916982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1174/2349] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:48.925162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-383483fe-00ce-4590-8f79-25eaec428129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05565736e4b1479f89db6e645a158020'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:48.931435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1176/2350] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:48 2022] DELETE /identity/v3/users/05565736e4b1479f89db6e645a158020 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:49.319187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18e99-1809-4426-869e-fe00c459c6b6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.320888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a7b18e99-1809-4426-869e-fe00c459c6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:49.341741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18e99-1809-4426-869e-fe00c459c6b6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.406485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.407177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.407417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.407690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] PATH_INFO: `/v3/projects/2ce289d1fec7430eb7ebc19fe21fd526` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.408852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce289d1fec7430eb7ebc19fe21fd526)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.410818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.464286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce289d1fec7430eb7ebc19fe21fd526', 'request_id': 'req-6972ac99-073d-4b08-b5e8-226d2b4b048d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.470514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce289d1fec7430eb7ebc19fe21fd526', 'request_id': 'req-6972ac99-073d-4b08-b5e8-226d2b4b048d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.477836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce289d1fec7430eb7ebc19fe21fd526', 'request_id': 'req-6972ac99-073d-4b08-b5e8-226d2b4b048d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.491507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] The token cache is being invalidate because project 2ce289d1fec7430eb7ebc19fe21fd526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:49.491937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.492585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6972ac99-073d-4b08-b5e8-226d2b4b048d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.494116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1175/2351] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:49 2022] DELETE /identity/v3/projects/2ce289d1fec7430eb7ebc19fe21fd526 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:49.500338 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20698f-fae6-4a34-a00c-e11ff59486f0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.500637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20698f-fae6-4a34-a00c-e11ff59486f0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.500911 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20698f-fae6-4a34-a00c-e11ff59486f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.521690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5b20698f-fae6-4a34-a00c-e11ff59486f0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:49.523005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5b20698f-fae6-4a34-a00c-e11ff59486f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:49.585873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1177/2352] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:49.593795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26ced-024c-4ad6-a49b-c3e2400fbe79 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.594085 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26ced-024c-4ad6-a49b-c3e2400fbe79 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.594359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26ced-024c-4ad6-a49b-c3e2400fbe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.629542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c7d26ced-024c-4ad6-a49b-c3e2400fbe79 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:49.630813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c7d26ced-024c-4ad6-a49b-c3e2400fbe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:49.642326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1176/2353] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:49.646551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20698f-fae6-4a34-a00c-e11ff59486f0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.656397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20698f-fae6-4a34-a00c-e11ff59486f0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.661114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.661771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.662053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.662511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.663211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:49.663661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.665559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.684849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1178/2354] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:49.686013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26ced-024c-4ad6-a49b-c3e2400fbe79 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.698889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26ced-024c-4ad6-a49b-c3e2400fbe79 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.704715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723be48-a5cf-4d2a-9118-fc67707a3935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.705589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723be48-a5cf-4d2a-9118-fc67707a3935 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.705874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723be48-a5cf-4d2a-9118-fc67707a3935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.706309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723be48-a5cf-4d2a-9118-fc67707a3935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.707001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723be48-a5cf-4d2a-9118-fc67707a3935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.709014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723be48-a5cf-4d2a-9118-fc67707a3935 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.742306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1177/2355] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:49.743715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.754460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9b1b1-7197-4a2d-b101-895d2a177ca7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.813117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95c465-c7a4-4b3d-ad31-91204fded719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.813844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95c465-c7a4-4b3d-ad31-91204fded719 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.814197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95c465-c7a4-4b3d-ad31-91204fded719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.814612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95c465-c7a4-4b3d-ad31-91204fded719 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.815327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95c465-c7a4-4b3d-ad31-91204fded719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.817395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95c465-c7a4-4b3d-ad31-91204fded719 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.839865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1179/2356] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:49.843935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723be48-a5cf-4d2a-9118-fc67707a3935 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.854856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723be48-a5cf-4d2a-9118-fc67707a3935 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.860693 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a51f2a-f5a3-4645-bfba-05ab0a8eeabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.861416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a51f2a-f5a3-4645-bfba-05ab0a8eeabf admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.861770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a51f2a-f5a3-4645-bfba-05ab0a8eeabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.862101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a51f2a-f5a3-4645-bfba-05ab0a8eeabf admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.862856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a51f2a-f5a3-4645-bfba-05ab0a8eeabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.864559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a51f2a-f5a3-4645-bfba-05ab0a8eeabf admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.875748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1178/2357] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:49.879993 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95c465-c7a4-4b3d-ad31-91204fded719 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.891959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95c465-c7a4-4b3d-ad31-91204fded719 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.900199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a46fa-2a24-495f-82ce-ec4ddd28c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.900868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a46fa-2a24-495f-82ce-ec4ddd28c017 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.901151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a46fa-2a24-495f-82ce-ec4ddd28c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.901426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a46fa-2a24-495f-82ce-ec4ddd28c017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.902150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a46fa-2a24-495f-82ce-ec4ddd28c017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.903779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a46fa-2a24-495f-82ce-ec4ddd28c017 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.906197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:49.920760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1180/2358] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:49.922543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a51f2a-f5a3-4645-bfba-05ab0a8eeabf admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.932875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a51f2a-f5a3-4645-bfba-05ab0a8eeabf admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.938001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.938718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.939083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.939793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] PATH_INFO: `/v3/projects/8639ea1242f84d8fa883f3369699a438/users/7a647da30d40494792acdb0fd6611c8e/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.955436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8639ea1242f84d8fa883f3369699a438, user_id=7a647da30d40494792acdb0fd6611c8e, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.958164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.972985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1179/2359] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:49 2022] PUT /identity/v3/projects/8639ea1242f84d8fa883f3369699a438/users/7a647da30d40494792acdb0fd6611c8e/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:49.983935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0de26-7311-45ca-82c0-1a5763ec85bf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.984358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0de26-7311-45ca-82c0-1a5763ec85bf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.984762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0de26-7311-45ca-82c0-1a5763ec85bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.014138 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aee0de26-7311-45ca-82c0-1a5763ec85bf None None] MFA Rules not processed for user `7a647da30d40494792acdb0fd6611c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:50.015404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aee0de26-7311-45ca-82c0-1a5763ec85bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.084616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1181/2360] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:50.120554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.122303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.141604 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:50.185940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c66161-6950-4777-9a37-35a1042416a5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.189668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721c2f1-d07f-4294-811c-3064568afa6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.190299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721c2f1-d07f-4294-811c-3064568afa6e service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.190585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721c2f1-d07f-4294-811c-3064568afa6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.190860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721c2f1-d07f-4294-811c-3064568afa6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.199994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721c2f1-d07f-4294-811c-3064568afa6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.201484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721c2f1-d07f-4294-811c-3064568afa6e service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.211214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1180/2361] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:50.226778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0de26-7311-45ca-82c0-1a5763ec85bf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.295936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0de26-7311-45ca-82c0-1a5763ec85bf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.300652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.301376 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.301661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.301951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] PATH_INFO: `/v3/users/7a647da30d40494792acdb0fd6611c8e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.303402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a647da30d40494792acdb0fd6611c8e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.305675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.354942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a647da30d40494792acdb0fd6611c8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.362176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a647da30d40494792acdb0fd6611c8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.369103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a647da30d40494792acdb0fd6611c8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.369791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a647da30d40494792acdb0fd6611c8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.381600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a647da30d40494792acdb0fd6611c8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.387456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1182/2362] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:44:50 2022] DELETE /identity/v3/users/7a647da30d40494792acdb0fd6611c8e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:50.392241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503fb5-286d-424c-8fca-521f6c1cae01 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.392729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503fb5-286d-424c-8fca-521f6c1cae01 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.392729 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503fb5-286d-424c-8fca-521f6c1cae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.413068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c6503fb5-286d-424c-8fca-521f6c1cae01 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:50.414276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c6503fb5-286d-424c-8fca-521f6c1cae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.472008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1181/2363] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:50.482205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.483631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.493283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:50.542930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55864835-e3ac-476d-adbe-d804906d73e1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.547002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb2aab-7a04-43fa-9e7a-018566f5b790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.547659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb2aab-7a04-43fa-9e7a-018566f5b790 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.547946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb2aab-7a04-43fa-9e7a-018566f5b790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.548224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb2aab-7a04-43fa-9e7a-018566f5b790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.558834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb2aab-7a04-43fa-9e7a-018566f5b790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.560339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb2aab-7a04-43fa-9e7a-018566f5b790 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.570773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1183/2364] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:50.896431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6503fb5-286d-424c-8fca-521f6c1cae01 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.897382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c6503fb5-286d-424c-8fca-521f6c1cae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.924406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6503fb5-286d-424c-8fca-521f6c1cae01 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.929483 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.930137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.930418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.930694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] PATH_INFO: `/v3/projects/8639ea1242f84d8fa883f3369699a438` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.932787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8639ea1242f84d8fa883f3369699a438)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.934812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.982777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8639ea1242f84d8fa883f3369699a438', 'request_id': 'req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.989274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8639ea1242f84d8fa883f3369699a438', 'request_id': 'req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.995893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8639ea1242f84d8fa883f3369699a438', 'request_id': 'req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:51.008569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] The token cache is being invalidate because project 8639ea1242f84d8fa883f3369699a438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:51.008857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:51.009543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c3076f4-b2f6-4c4b-bb84-13c5b58b8bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:51.011996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1182/2365] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:44:50 2022] DELETE /identity/v3/projects/8639ea1242f84d8fa883f3369699a438 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:51.017946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194357-17fb-4185-888c-a7c8ec589e77 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.018435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194357-17fb-4185-888c-a7c8ec589e77 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.018527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194357-17fb-4185-888c-a7c8ec589e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.039623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4f194357-17fb-4185-888c-a7c8ec589e77 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:51.040847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4f194357-17fb-4185-888c-a7c8ec589e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:51.102126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1184/2366] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:51.169173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e38a32-4475-40ef-9734-c86c386e81ed None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.169464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e38a32-4475-40ef-9734-c86c386e81ed None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.169750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e38a32-4475-40ef-9734-c86c386e81ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.191989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-54e38a32-4475-40ef-9734-c86c386e81ed None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:51.193136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-54e38a32-4475-40ef-9734-c86c386e81ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:51.202305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1183/2367] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:51.206683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194357-17fb-4185-888c-a7c8ec589e77 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.217306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194357-17fb-4185-888c-a7c8ec589e77 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.222015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.222660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.222943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.223340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.224062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:51.224366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.226006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.247759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1185/2368] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:51.249031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e38a32-4475-40ef-9734-c86c386e81ed None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.258259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e38a32-4475-40ef-9734-c86c386e81ed None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.263322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f9b36-a04b-4c04-ad90-e8a18a18d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.263841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f9b36-a04b-4c04-ad90-e8a18a18d84d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.264114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f9b36-a04b-4c04-ad90-e8a18a18d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.264382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f9b36-a04b-4c04-ad90-e8a18a18d84d admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.265047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f9b36-a04b-4c04-ad90-e8a18a18d84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.266938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f9b36-a04b-4c04-ad90-e8a18a18d84d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.297739 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1184/2369] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:44:51 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:51.299579 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.310811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308348-e85e-4e26-8302-df66fbea188a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.368947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339632d-fa9d-4cef-a692-fc8eebe58a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.370132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339632d-fa9d-4cef-a692-fc8eebe58a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.370417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339632d-fa9d-4cef-a692-fc8eebe58a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.370692 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339632d-fa9d-4cef-a692-fc8eebe58a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.371390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339632d-fa9d-4cef-a692-fc8eebe58a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.373386 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339632d-fa9d-4cef-a692-fc8eebe58a25 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.398900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1186/2370] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:44:51 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:44:51.400302 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f9b36-a04b-4c04-ad90-e8a18a18d84d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.411030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f9b36-a04b-4c04-ad90-e8a18a18d84d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.415853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bee8f7-11d8-41a5-97fd-b6cb1915acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.417134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee8f7-11d8-41a5-97fd-b6cb1915acf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.417414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee8f7-11d8-41a5-97fd-b6cb1915acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.417684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee8f7-11d8-41a5-97fd-b6cb1915acf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.418375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bee8f7-11d8-41a5-97fd-b6cb1915acf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.420014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bee8f7-11d8-41a5-97fd-b6cb1915acf4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.430998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1185/2371] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:44:51.435889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339632d-fa9d-4cef-a692-fc8eebe58a25 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.448146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339632d-fa9d-4cef-a692-fc8eebe58a25 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.453230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b3986-de0f-454a-a81d-793a60499fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.454022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b3986-de0f-454a-a81d-793a60499fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.454311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b3986-de0f-454a-a81d-793a60499fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.454589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b3986-de0f-454a-a81d-793a60499fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.455312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b3986-de0f-454a-a81d-793a60499fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.457896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b3986-de0f-454a-a81d-793a60499fe5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.473016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1187/2372] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:51.474525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bee8f7-11d8-41a5-97fd-b6cb1915acf4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.480723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:51.491661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bee8f7-11d8-41a5-97fd-b6cb1915acf4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.499296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.500150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.500700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.501626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] PATH_INFO: `/v3/projects/8e4a13d5b7df4543a9c5b20456b708e3/users/53c41991c6fb4ff6abd939d3e7da31b4/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.522075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4a13d5b7df4543a9c5b20456b708e3, user_id=53c41991c6fb4ff6abd939d3e7da31b4, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.525689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.551448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1186/2373] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:44:51 2022] PUT /identity/v3/projects/8e4a13d5b7df4543a9c5b20456b708e3/users/53c41991c6fb4ff6abd939d3e7da31b4/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:51.564442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6337b-affc-4bdb-865b-2ef5b6a0e167 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.564724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6337b-affc-4bdb-865b-2ef5b6a0e167 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.564999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6337b-affc-4bdb-865b-2ef5b6a0e167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.608473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0ce6337b-affc-4bdb-865b-2ef5b6a0e167 None None] MFA Rules not processed for user `53c41991c6fb4ff6abd939d3e7da31b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:51.609724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0ce6337b-affc-4bdb-865b-2ef5b6a0e167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:51.614515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:51.693880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1188/2374] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:51.701780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.703811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:51.766010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457cfdd-8e56-49aa-bf05-af1f9e4934c0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.769747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf1f71-8073-4029-bb3b-89674d67c00c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.770366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1f71-8073-4029-bb3b-89674d67c00c service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.770644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1f71-8073-4029-bb3b-89674d67c00c service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.770918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1f71-8073-4029-bb3b-89674d67c00c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.779740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf1f71-8073-4029-bb3b-89674d67c00c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.781229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf1f71-8073-4029-bb3b-89674d67c00c service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.790275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1187/2375] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:44:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:53.199600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75541069-3acd-4e72-aa41-2cd50614942d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:53.200095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75541069-3acd-4e72-aa41-2cd50614942d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:53.200217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75541069-3acd-4e72-aa41-2cd50614942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:53.218912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-75541069-3acd-4e72-aa41-2cd50614942d None None] MFA Rules not processed for user `53c41991c6fb4ff6abd939d3e7da31b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:53.220153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-75541069-3acd-4e72-aa41-2cd50614942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:53.227181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1189/2376] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:44:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:01.786185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:03.213696 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=28 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:13.080775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b223a-9281-483a-bcc8-c3a5deb71de6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.081295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b223a-9281-483a-bcc8-c3a5deb71de6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.081403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b223a-9281-483a-bcc8-c3a5deb71de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.100660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-384b223a-9281-483a-bcc8-c3a5deb71de6 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:13.101862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-384b223a-9281-483a-bcc8-c3a5deb71de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:13.156993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1188/2377] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:13.204411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75541069-3acd-4e72-aa41-2cd50614942d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:13.205854 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-75541069-3acd-4e72-aa41-2cd50614942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:13.309592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75541069-3acd-4e72-aa41-2cd50614942d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:13.314583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b1d3-ed35-4146-8dda-3c242bbb83dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:13.315208 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b1d3-ed35-4146-8dda-3c242bbb83dc service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.315525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b1d3-ed35-4146-8dda-3c242bbb83dc service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.315802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b1d3-ed35-4146-8dda-3c242bbb83dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.323936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34b1d3-ed35-4146-8dda-3c242bbb83dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:13.325572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34b1d3-ed35-4146-8dda-3c242bbb83dc service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:13.337848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1190/2378] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:45:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:45:13.855577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18008-8c4d-4b72-af32-90ae6cb66cfd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.855839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18008-8c4d-4b72-af32-90ae6cb66cfd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.856100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18008-8c4d-4b72-af32-90ae6cb66cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.875243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0da18008-8c4d-4b72-af32-90ae6cb66cfd None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:13.876502 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0da18008-8c4d-4b72-af32-90ae6cb66cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:13.907957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1189/2379] 10.222.0.71 () {58 vars in 967 bytes} [Mon Aug 1 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:13.920795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b1d3-ed35-4146-8dda-3c242bbb83dc service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:13.938176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b1d3-ed35-4146-8dda-3c242bbb83dc service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:13.943324 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dd688-1819-4b97-9be8-bbfeb09bab95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:13.943961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd688-1819-4b97-9be8-bbfeb09bab95 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.944242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd688-1819-4b97-9be8-bbfeb09bab95 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.944514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd688-1819-4b97-9be8-bbfeb09bab95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.953390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dd688-1819-4b97-9be8-bbfeb09bab95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:13.955060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dd688-1819-4b97-9be8-bbfeb09bab95 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:13.963134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1191/2380] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:45:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:45:14.196303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bf9ca-8a02-498b-be8c-d773a505cb93 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.196808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bf9ca-8a02-498b-be8c-d773a505cb93 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.196933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bf9ca-8a02-498b-be8c-d773a505cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.216665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-bb9bf9ca-8a02-498b-be8c-d773a505cb93 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:14.217784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bb9bf9ca-8a02-498b-be8c-d773a505cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:14.225100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1190/2381] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:14.249222 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dd688-1819-4b97-9be8-bbfeb09bab95 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:14.260265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dd688-1819-4b97-9be8-bbfeb09bab95 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:14.266413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd3259-f509-41fc-8184-a0a37f33d222 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:14.267031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3259-f509-41fc-8184-a0a37f33d222 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.267321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3259-f509-41fc-8184-a0a37f33d222 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.267637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3259-f509-41fc-8184-a0a37f33d222 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.278129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd3259-f509-41fc-8184-a0a37f33d222 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:14.279916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd3259-f509-41fc-8184-a0a37f33d222 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:14.291205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1192/2382] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:45:14.652848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814135-9ecc-4b15-ba7c-ad90015fb5fd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.653145 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814135-9ecc-4b15-ba7c-ad90015fb5fd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.653541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814135-9ecc-4b15-ba7c-ad90015fb5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.685571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-77814135-9ecc-4b15-ba7c-ad90015fb5fd None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:14.686938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-77814135-9ecc-4b15-ba7c-ad90015fb5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:14.699363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1191/2383] 10.222.0.71 () {58 vars in 967 bytes} [Mon Aug 1 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:14.714454 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd3259-f509-41fc-8184-a0a37f33d222 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:14.725825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd3259-f509-41fc-8184-a0a37f33d222 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:14.733015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299b96-3a44-4581-a3ec-fa75c4ae261e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:14.733887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299b96-3a44-4581-a3ec-fa75c4ae261e service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.734258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299b96-3a44-4581-a3ec-fa75c4ae261e service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.734562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299b96-3a44-4581-a3ec-fa75c4ae261e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.746570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5299b96-3a44-4581-a3ec-fa75c4ae261e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:14.748310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5299b96-3a44-4581-a3ec-fa75c4ae261e service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:14.757987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1193/2384] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 15:45:16.961294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814135-9ecc-4b15-ba7c-ad90015fb5fd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:17.051428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814135-9ecc-4b15-ba7c-ad90015fb5fd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:17.056495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:17.057144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.057431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.058251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] PATH_INFO: `/v3/users/53c41991c6fb4ff6abd939d3e7da31b4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.059489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c41991c6fb4ff6abd939d3e7da31b4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:17.061434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:17.113446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c41991c6fb4ff6abd939d3e7da31b4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.115300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:17.125239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c41991c6fb4ff6abd939d3e7da31b4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.126019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c41991c6fb4ff6abd939d3e7da31b4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.141124 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c41991c6fb4ff6abd939d3e7da31b4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.141948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c41991c6fb4ff6abd939d3e7da31b4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.154402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1192/2385] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:45:16 2022] DELETE /identity/v3/users/53c41991c6fb4ff6abd939d3e7da31b4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:17.158988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faabbd-6dab-4671-903f-2c98d7098f7a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.159470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faabbd-6dab-4671-903f-2c98d7098f7a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.159585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faabbd-6dab-4671-903f-2c98d7098f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.200035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-53faabbd-6dab-4671-903f-2c98d7098f7a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:17.201253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-53faabbd-6dab-4671-903f-2c98d7098f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:17.250012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:17.263251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1194/2386] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:17.272900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:17.274334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:17.334216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102824c-3712-46dd-9b8a-6eba1264ccc8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:17.337756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574833a-929d-4bbf-992e-27fb47d10b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:17.338371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574833a-929d-4bbf-992e-27fb47d10b41 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.338649 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574833a-929d-4bbf-992e-27fb47d10b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.338935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574833a-929d-4bbf-992e-27fb47d10b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.347783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574833a-929d-4bbf-992e-27fb47d10b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:17.349217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574833a-929d-4bbf-992e-27fb47d10b41 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:17.358553 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1193/2387] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:17.530093 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faabbd-6dab-4671-903f-2c98d7098f7a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:17.531594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-53faabbd-6dab-4671-903f-2c98d7098f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:17.551133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faabbd-6dab-4671-903f-2c98d7098f7a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:17.556556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:17.557111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.557397 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.557727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] PATH_INFO: `/v3/projects/8e4a13d5b7df4543a9c5b20456b708e3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.559475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4a13d5b7df4543a9c5b20456b708e3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:17.561410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:17.607465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4a13d5b7df4543a9c5b20456b708e3', 'request_id': 'req-c39ac88c-c598-4103-be87-b71a457ea59f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.615184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4a13d5b7df4543a9c5b20456b708e3', 'request_id': 'req-c39ac88c-c598-4103-be87-b71a457ea59f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.621922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4a13d5b7df4543a9c5b20456b708e3', 'request_id': 'req-c39ac88c-c598-4103-be87-b71a457ea59f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.633240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] The token cache is being invalidate because project 8e4a13d5b7df4543a9c5b20456b708e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:17.633528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.634367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c39ac88c-c598-4103-be87-b71a457ea59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:17.635768 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1195/2388] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:45:17 2022] DELETE /identity/v3/projects/8e4a13d5b7df4543a9c5b20456b708e3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:17.640913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bf307-dfed-4da4-894c-49e886e87757 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.641228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bf307-dfed-4da4-894c-49e886e87757 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.641505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bf307-dfed-4da4-894c-49e886e87757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.691467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-782bf307-dfed-4da4-894c-49e886e87757 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:17.692675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-782bf307-dfed-4da4-894c-49e886e87757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:17.750834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1194/2389] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:17.758564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c75fa-a213-4b18-83ae-f6e3ccbf5bf2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.758852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c75fa-a213-4b18-83ae-f6e3ccbf5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.759128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c75fa-a213-4b18-83ae-f6e3ccbf5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.780357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b84c75fa-a213-4b18-83ae-f6e3ccbf5bf2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:17.781670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b84c75fa-a213-4b18-83ae-f6e3ccbf5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:17.789473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1196/2390] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:17.794305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bf307-dfed-4da4-894c-49e886e87757 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:17.804144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bf307-dfed-4da4-894c-49e886e87757 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:17.809574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:17.810185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.810467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.810741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.811468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:17.811779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:17.813391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:17.825058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1195/2391] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:17.829239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c75fa-a213-4b18-83ae-f6e3ccbf5bf2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:17.838470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c75fa-a213-4b18-83ae-f6e3ccbf5bf2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:17.845868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df07c08-8943-489c-ba39-78612c794553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:17.846552 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07c08-8943-489c-ba39-78612c794553 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.846919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07c08-8943-489c-ba39-78612c794553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.847232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07c08-8943-489c-ba39-78612c794553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.848127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df07c08-8943-489c-ba39-78612c794553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:17.850282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df07c08-8943-489c-ba39-78612c794553 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:17.880465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1197/2392] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:45:17 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:17.887839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:17.897886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583e3f-f6b9-4188-b997-1edda1531994 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:17.927673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:17.958478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcaad7-4e81-4d78-b3dd-a5608c37840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:17.959099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcaad7-4e81-4d78-b3dd-a5608c37840a admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:17.959449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcaad7-4e81-4d78-b3dd-a5608c37840a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:17.959732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcaad7-4e81-4d78-b3dd-a5608c37840a admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:17.960412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcaad7-4e81-4d78-b3dd-a5608c37840a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:17.962344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcaad7-4e81-4d78-b3dd-a5608c37840a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:17.987989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1196/2393] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:45:17 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:17.989235 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df07c08-8943-489c-ba39-78612c794553 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:17.999491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df07c08-8943-489c-ba39-78612c794553 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:18.004095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c945c-4b56-4068-95fd-462d7cc02110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:18.004699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c945c-4b56-4068-95fd-462d7cc02110 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:18.004978 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c945c-4b56-4068-95fd-462d7cc02110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:18.005248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c945c-4b56-4068-95fd-462d7cc02110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:18.005926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c945c-4b56-4068-95fd-462d7cc02110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:18.007548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c945c-4b56-4068-95fd-462d7cc02110 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:18.018383 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1198/2394] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:18.022314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcaad7-4e81-4d78-b3dd-a5608c37840a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:18.032625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcaad7-4e81-4d78-b3dd-a5608c37840a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:18.037147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedebba-3f3a-48e2-a130-5077b47d3bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:18.037750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedebba-3f3a-48e2-a130-5077b47d3bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:18.038030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedebba-3f3a-48e2-a130-5077b47d3bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:18.038303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedebba-3f3a-48e2-a130-5077b47d3bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:18.039008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedebba-3f3a-48e2-a130-5077b47d3bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:18.040653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedebba-3f3a-48e2-a130-5077b47d3bf5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:18.051704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1197/2395] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:18.056322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c945c-4b56-4068-95fd-462d7cc02110 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:18.066205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c945c-4b56-4068-95fd-462d7cc02110 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:18.070803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:18.071519 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:18.071782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:18.072059 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] PATH_INFO: `/v3/projects/176ae4b7fad74d239b19248fd2d5b9cb/users/783182ac7f354aa59c88f9dbeb715bac/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:18.086535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176ae4b7fad74d239b19248fd2d5b9cb, user_id=783182ac7f354aa59c88f9dbeb715bac, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:18.089819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:18.102715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1199/2396] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:45:18 2022] PUT /identity/v3/projects/176ae4b7fad74d239b19248fd2d5b9cb/users/783182ac7f354aa59c88f9dbeb715bac/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:18.108579 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cc4d-c0af-4f3b-8c72-882f429ae8d3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:18.108867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cc4d-c0af-4f3b-8c72-882f429ae8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:18.109141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cc4d-c0af-4f3b-8c72-882f429ae8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:18.127868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1696cc4d-c0af-4f3b-8c72-882f429ae8d3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:18.129068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1696cc4d-c0af-4f3b-8c72-882f429ae8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:18.187234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1198/2397] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:18.196803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:18.199002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:18.257258 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667065-b9ff-4ed3-b5a7-0ea529ea8558 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:18.261403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0cb74-1c95-4203-9748-001d252f0967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:18.262016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0cb74-1c95-4203-9748-001d252f0967 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:18.262296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0cb74-1c95-4203-9748-001d252f0967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:18.262566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0cb74-1c95-4203-9748-001d252f0967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:18.271173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0cb74-1c95-4203-9748-001d252f0967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:18.272652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0cb74-1c95-4203-9748-001d252f0967 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:18.282505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1200/2398] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:22.357805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbebf4-9aa5-4928-a3b7-c19c9ea0a001 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.358323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbebf4-9aa5-4928-a3b7-c19c9ea0a001 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.358424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbebf4-9aa5-4928-a3b7-c19c9ea0a001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.387610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4abbebf4-9aa5-4928-a3b7-c19c9ea0a001 None None] MFA Rules not processed for user `783182ac7f354aa59c88f9dbeb715bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:22.388822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4abbebf4-9aa5-4928-a3b7-c19c9ea0a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:22.476401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1199/2399] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:45:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:22.481521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0cb74-1c95-4203-9748-001d252f0967 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:22.491242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0cb74-1c95-4203-9748-001d252f0967 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:22.499660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941c1d4-a7ca-46fd-bd67-9aa1daae04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:22.500591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941c1d4-a7ca-46fd-bd67-9aa1daae04c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.501044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941c1d4-a7ca-46fd-bd67-9aa1daae04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.502603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941c1d4-a7ca-46fd-bd67-9aa1daae04c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.503509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941c1d4-a7ca-46fd-bd67-9aa1daae04c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:22.505506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941c1d4-a7ca-46fd-bd67-9aa1daae04c6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:22.521080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:22.543593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1201/2400] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:45:22 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:22.545057 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbebf4-9aa5-4928-a3b7-c19c9ea0a001 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:22.557113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbebf4-9aa5-4928-a3b7-c19c9ea0a001 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:22.601466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:22.623356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e550c-caf7-48b0-a69f-b5dc03a54a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:22.624093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e550c-caf7-48b0-a69f-b5dc03a54a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.624372 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e550c-caf7-48b0-a69f-b5dc03a54a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.624644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e550c-caf7-48b0-a69f-b5dc03a54a11 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.625313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e550c-caf7-48b0-a69f-b5dc03a54a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:22.627304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e550c-caf7-48b0-a69f-b5dc03a54a11 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:22.649930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1200/2401] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:45:22 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:22.654758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941c1d4-a7ca-46fd-bd67-9aa1daae04c6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:22.666053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941c1d4-a7ca-46fd-bd67-9aa1daae04c6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:22.672245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fa407-e049-4f76-a85d-8edc980bb2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:22.672877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa407-e049-4f76-a85d-8edc980bb2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.673156 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa407-e049-4f76-a85d-8edc980bb2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.673425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa407-e049-4f76-a85d-8edc980bb2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.674249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fa407-e049-4f76-a85d-8edc980bb2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:22.676112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fa407-e049-4f76-a85d-8edc980bb2b6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:22.688698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1202/2402] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:22.692895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e550c-caf7-48b0-a69f-b5dc03a54a11 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:22.705675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e550c-caf7-48b0-a69f-b5dc03a54a11 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:22.710944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6472-b909-4eec-b711-72150aeaaa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:22.711781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6472-b909-4eec-b711-72150aeaaa5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.712128 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6472-b909-4eec-b711-72150aeaaa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.712329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6472-b909-4eec-b711-72150aeaaa5d admin admin] PATH_INFO: `/v3/projects/4d458c6d1ce7495587d8cb8fd9ad8036/users/0a029a1fb3984f62823c1c248364fffc/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.728836 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc6472-b909-4eec-b711-72150aeaaa5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d458c6d1ce7495587d8cb8fd9ad8036, user_id=0a029a1fb3984f62823c1c248364fffc, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:22.731623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc6472-b909-4eec-b711-72150aeaaa5d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:22.746092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1201/2403] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:45:22 2022] PUT /identity/v3/projects/4d458c6d1ce7495587d8cb8fd9ad8036/users/0a029a1fb3984f62823c1c248364fffc/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:22.750189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fa407-e049-4f76-a85d-8edc980bb2b6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:22.762336 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fa407-e049-4f76-a85d-8edc980bb2b6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:22.829320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2bbae-577c-44b3-b46d-7979b15c8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:22.830065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2bbae-577c-44b3-b46d-7979b15c8472 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.830529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2bbae-577c-44b3-b46d-7979b15c8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.830987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2bbae-577c-44b3-b46d-7979b15c8472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.831920 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2bbae-577c-44b3-b46d-7979b15c8472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:22.833706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2bbae-577c-44b3-b46d-7979b15c8472 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:22.854340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1203/2404] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:22.858239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6472-b909-4eec-b711-72150aeaaa5d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:22.869525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6472-b909-4eec-b711-72150aeaaa5d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:22.892217 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:22.898046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.901461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.901461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] PATH_INFO: `/v3/projects/4d458c6d1ce7495587d8cb8fd9ad8036/users/0a029a1fb3984f62823c1c248364fffc/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.912884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d458c6d1ce7495587d8cb8fd9ad8036, user_id=0a029a1fb3984f62823c1c248364fffc, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:22.916211 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:22.937327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1202/2405] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:45:22 2022] PUT /identity/v3/projects/4d458c6d1ce7495587d8cb8fd9ad8036/users/0a029a1fb3984f62823c1c248364fffc/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:27.393373 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e5078-d353-4243-a7cb-d48e2bed9b6e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.393895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e5078-d353-4243-a7cb-d48e2bed9b6e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.394009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e5078-d353-4243-a7cb-d48e2bed9b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.423232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8c9e5078-d353-4243-a7cb-d48e2bed9b6e None None] MFA Rules not processed for user `0a029a1fb3984f62823c1c248364fffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:27.424484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8c9e5078-d353-4243-a7cb-d48e2bed9b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:27.498648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1204/2406] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:27.512042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.514548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:27.595985 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c980597-20dc-4abb-b5c7-5561e2ed3e44 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.599716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03250eb151044619c0f720f315b8509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.600337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.600616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.600904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.663467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.665037 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.677007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1203/2407] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:45:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:27.861585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b512aa-dfef-4cc6-8d61-6fd1e8ef9df0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.862119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b512aa-dfef-4cc6-8d61-6fd1e8ef9df0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.862631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b512aa-dfef-4cc6-8d61-6fd1e8ef9df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.898569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-44b512aa-dfef-4cc6-8d61-6fd1e8ef9df0 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:27.899983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-44b512aa-dfef-4cc6-8d61-6fd1e8ef9df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:27.953057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:27.961909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1205/2408] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:27.974484 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.976038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:28.031893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:28.055499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1e032-f3f8-44a0-afa0-c9b04a06e530 service glance] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:28.060886 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acefa6c-9b9c-4231-9116-0297fb5714e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:28.061671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acefa6c-9b9c-4231-9116-0297fb5714e2 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:28.061797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acefa6c-9b9c-4231-9116-0297fb5714e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:28.062074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acefa6c-9b9c-4231-9116-0297fb5714e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:28.071249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acefa6c-9b9c-4231-9116-0297fb5714e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:28.073110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acefa6c-9b9c-4231-9116-0297fb5714e2 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:28.082400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1204/2409] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:45:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:45:36.851058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275054b-a5e7-45f9-be8a-cd3768adbe79 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.851566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275054b-a5e7-45f9-be8a-cd3768adbe79 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.851566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275054b-a5e7-45f9-be8a-cd3768adbe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.870514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f275054b-a5e7-45f9-be8a-cd3768adbe79 None None] MFA Rules not processed for user `783182ac7f354aa59c88f9dbeb715bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:36.871742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f275054b-a5e7-45f9-be8a-cd3768adbe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:36.878494 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1206/2410] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:38.078741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=11 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:39.786392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9ad0-7847-44cc-ac13-afa5bf7edead None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:39.787326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9ad0-7847-44cc-ac13-afa5bf7edead None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:39.787799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9ad0-7847-44cc-ac13-afa5bf7edead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:39.807033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-bddf9ad0-7847-44cc-ac13-afa5bf7edead None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:39.808309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bddf9ad0-7847-44cc-ac13-afa5bf7edead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:39.815451 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1205/2411] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:39.828478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275054b-a5e7-45f9-be8a-cd3768adbe79 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:39.841537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275054b-a5e7-45f9-be8a-cd3768adbe79 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:39.846791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ba1d3-58bb-4d94-aaa1-5fc12fbba6ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:39.847610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba1d3-58bb-4d94-aaa1-5fc12fbba6ec service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:39.847919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba1d3-58bb-4d94-aaa1-5fc12fbba6ec service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:39.848196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba1d3-58bb-4d94-aaa1-5fc12fbba6ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:39.856987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ba1d3-58bb-4d94-aaa1-5fc12fbba6ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:39.858604 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ba1d3-58bb-4d94-aaa1-5fc12fbba6ec service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:39.867569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1207/2412] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:45:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 15:45:49.801587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:49.863970 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=9 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:04.168103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf9ad0-7847-44cc-ac13-afa5bf7edead None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:04.169678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bddf9ad0-7847-44cc-ac13-afa5bf7edead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:04.279134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf9ad0-7847-44cc-ac13-afa5bf7edead None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:04.284841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:04.285457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:04.285736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:04.286011 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:04.287841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:04.300505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:04.302104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:04.312837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1206/2413] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:46:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:09.326002 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84bdd-7966-4719-bae9-d813f787cccc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:09.327131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84bdd-7966-4719-bae9-d813f787cccc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:09.327131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84bdd-7966-4719-bae9-d813f787cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:09.345969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d1e84bdd-7966-4719-bae9-d813f787cccc None None] MFA Rules not processed for user `b325a118b0964730ada2630cd2b47fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:09.347202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d1e84bdd-7966-4719-bae9-d813f787cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:09.402586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1208/2414] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:12.546192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.620573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800507-3ffc-48d9-829c-91ce841e2ca0 service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.625199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e246f9-7806-4a94-b676-b032247fc54b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.626331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e246f9-7806-4a94-b676-b032247fc54b service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.626480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e246f9-7806-4a94-b676-b032247fc54b service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.626857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e246f9-7806-4a94-b676-b032247fc54b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.649626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e246f9-7806-4a94-b676-b032247fc54b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.651281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e246f9-7806-4a94-b676-b032247fc54b service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.661907 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1207/2415] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:46:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:19.396001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=25 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:22.657370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=71 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:28.483859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c862-23df-49c1-a8ad-d0a5ff3c1204 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:28.484366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c862-23df-49c1-a8ad-d0a5ff3c1204 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:28.484528 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c862-23df-49c1-a8ad-d0a5ff3c1204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:28.504718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-89e0c862-23df-49c1-a8ad-d0a5ff3c1204 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:28.505867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-89e0c862-23df-49c1-a8ad-d0a5ff3c1204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:28.514636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1209/2416] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:28.536027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e246f9-7806-4a94-b676-b032247fc54b service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:28.547406 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e246f9-7806-4a94-b676-b032247fc54b service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:28.552432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78196c02-f14f-4ae3-819c-d98ce4f5536b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:28.553046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196c02-f14f-4ae3-819c-d98ce4f5536b service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:28.553337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196c02-f14f-4ae3-819c-d98ce4f5536b service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:28.553617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196c02-f14f-4ae3-819c-d98ce4f5536b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:28.562281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78196c02-f14f-4ae3-819c-d98ce4f5536b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:28.563967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78196c02-f14f-4ae3-819c-d98ce4f5536b service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:28.572526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1208/2417] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:46:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:46:38.498996 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:38.568810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:42.171573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c862-23df-49c1-a8ad-d0a5ff3c1204 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:42.173024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-89e0c862-23df-49c1-a8ad-d0a5ff3c1204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:42.200239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c862-23df-49c1-a8ad-d0a5ff3c1204 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:42.203829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc41be-fcc7-4460-a4cf-a27a62454411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:42.204447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc41be-fcc7-4460-a4cf-a27a62454411 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:42.204726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc41be-fcc7-4460-a4cf-a27a62454411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:42.204995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc41be-fcc7-4460-a4cf-a27a62454411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:42.206704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-70dc41be-fcc7-4460-a4cf-a27a62454411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:42.268378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc41be-fcc7-4460-a4cf-a27a62454411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:42.269808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc41be-fcc7-4460-a4cf-a27a62454411 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:42.279264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1210/2418] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:46:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:48.232452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78196c02-f14f-4ae3-819c-d98ce4f5536b service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:48.242123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78196c02-f14f-4ae3-819c-d98ce4f5536b service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:48.245806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:48.246422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:48.246706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:48.247651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:48.249545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:48.313258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:48.314705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:48.324387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1209/2419] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:49.248517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ebdb2-97ef-46fa-a847-5487b3090aeb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:49.248991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ebdb2-97ef-46fa-a847-5487b3090aeb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:49.249087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ebdb2-97ef-46fa-a847-5487b3090aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:49.269230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8c1ebdb2-97ef-46fa-a847-5487b3090aeb None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:49.270804 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8c1ebdb2-97ef-46fa-a847-5487b3090aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:49.278816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1211/2420] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Aug 1 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:49.291073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:49.303313 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637d62-d725-4a4a-b95a-78df84bb840d service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:49.308690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4a92-a212-403a-a708-74a1d2f2029e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:49.309312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4a92-a212-403a-a708-74a1d2f2029e service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:49.309595 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4a92-a212-403a-a708-74a1d2f2029e service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:49.309871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4a92-a212-403a-a708-74a1d2f2029e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:49.318412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4a92-a212-403a-a708-74a1d2f2029e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:49.320279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4a92-a212-403a-a708-74a1d2f2029e service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:49.329061 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1210/2421] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:46:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:46:52.740828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ebdb2-97ef-46fa-a847-5487b3090aeb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:52.763593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ebdb2-97ef-46fa-a847-5487b3090aeb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:52.769323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:52.770435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:52.770889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:52.771359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:52.773707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:52.788363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:52.793025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:52.811912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1212/2422] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:56.368016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4a92-a212-403a-a708-74a1d2f2029e service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:56.387501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4a92-a212-403a-a708-74a1d2f2029e service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:56.394036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:56.395006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:56.395472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:56.395915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:56.398520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:56.438357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:56.441526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:56.467119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1211/2423] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:46:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:56.746622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:56.749591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:56.773022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d0dd8-e13d-44b3-b26b-eb86894ba834 service placement] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:56.785335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:56.786310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:56.786935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:56.787509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] PATH_INFO: `/v3/users/2b864aa8a7a04f11813ac1ac62d9fd34` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:56.789252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b864aa8a7a04f11813ac1ac62d9fd34)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:56.791898 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:56.927392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b864aa8a7a04f11813ac1ac62d9fd34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:56.942765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b864aa8a7a04f11813ac1ac62d9fd34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:56.971969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b864aa8a7a04f11813ac1ac62d9fd34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:56.972744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b864aa8a7a04f11813ac1ac62d9fd34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:56.990061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b864aa8a7a04f11813ac1ac62d9fd34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:56.997632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1213/2424] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:46:56 2022] DELETE /identity/v3/users/2b864aa8a7a04f11813ac1ac62d9fd34 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:57.216778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:57.265334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ada04-afc2-4b0a-bfb6-290e9108dc40 service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:57.324953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:57.326256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:57.326538 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:57.326817 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] PATH_INFO: `/v3/projects/05708e99facb4eb68ba0a4ce6a04a78c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:57.328048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05708e99facb4eb68ba0a4ce6a04a78c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:57.329978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:57.389447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05708e99facb4eb68ba0a4ce6a04a78c', 'request_id': 'req-93ceaa1e-3160-43d8-898d-4540283c5186'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.399367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05708e99facb4eb68ba0a4ce6a04a78c', 'request_id': 'req-93ceaa1e-3160-43d8-898d-4540283c5186'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.406120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05708e99facb4eb68ba0a4ce6a04a78c', 'request_id': 'req-93ceaa1e-3160-43d8-898d-4540283c5186'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.414650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:57.419888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] The token cache is being invalidate because project 05708e99facb4eb68ba0a4ce6a04a78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:57.420995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.421751 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.423982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1212/2425] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:46:57 2022] DELETE /identity/v3/projects/05708e99facb4eb68ba0a4ce6a04a78c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:57.427960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:57.429367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:57.444032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c218e-2bf7-4f68-81dc-72d0de13c9af admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:57.487719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:57.509396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:57.509967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:57.510246 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:57.510516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] PATH_INFO: `/v3/users/0d7b3918f44e44a48e92cc211c04788c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:57.511699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7b3918f44e44a48e92cc211c04788c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:57.514272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:57.569245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7b3918f44e44a48e92cc211c04788c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.576905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7b3918f44e44a48e92cc211c04788c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.584534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7b3918f44e44a48e92cc211c04788c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.585056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7b3918f44e44a48e92cc211c04788c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.598024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8b55b2de-66a0-4651-9111-cb67b118be6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7b3918f44e44a48e92cc211c04788c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.604546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1214/2426] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:46:57 2022] DELETE /identity/v3/users/0d7b3918f44e44a48e92cc211c04788c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:57.798156 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:57.799887 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:57.815598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceaa1e-3160-43d8-898d-4540283c5186 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:57.880844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:57.881775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:57.881775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:57.882059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] PATH_INFO: `/v3/projects/80d4c96ba03b432f8afbfa4bbdcd7eee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:57.883716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d4c96ba03b432f8afbfa4bbdcd7eee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:57.885789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:57.936613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d4c96ba03b432f8afbfa4bbdcd7eee', 'request_id': 'req-6251add6-5b54-4edc-80cc-6fb7717ab5be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.946027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d4c96ba03b432f8afbfa4bbdcd7eee', 'request_id': 'req-6251add6-5b54-4edc-80cc-6fb7717ab5be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.952666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d4c96ba03b432f8afbfa4bbdcd7eee', 'request_id': 'req-6251add6-5b54-4edc-80cc-6fb7717ab5be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.969043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] The token cache is being invalidate because project 80d4c96ba03b432f8afbfa4bbdcd7eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:57.969561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.970495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:57.972798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1213/2427] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:46:57 2022] DELETE /identity/v3/projects/80d4c96ba03b432f8afbfa4bbdcd7eee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:07.600648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:07.964568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:10.684343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5fedf-7941-44be-81b9-f99ff3b0fc27 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:10.684824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5fedf-7941-44be-81b9-f99ff3b0fc27 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:10.684923 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5fedf-7941-44be-81b9-f99ff3b0fc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:10.705838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d9c5fedf-7941-44be-81b9-f99ff3b0fc27 None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:10.707064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d9c5fedf-7941-44be-81b9-f99ff3b0fc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:10.767244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1215/2428] 10.222.0.71 () {58 vars in 967 bytes} [Mon Aug 1 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:10.779748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:10.781149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:10.850445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251add6-5b54-4edc-80cc-6fb7717ab5be admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:10.856093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:10.856743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:10.857021 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:10.857296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:10.866253 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:10.867898 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:10.877000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1214/2429] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:47:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:47:20.754925 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=25 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:20.872742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=32 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:26.771519 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5fedf-7941-44be-81b9-f99ff3b0fc27 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:26.772937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d9c5fedf-7941-44be-81b9-f99ff3b0fc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:26.829775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5fedf-7941-44be-81b9-f99ff3b0fc27 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:26.833411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:26.834041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:26.834325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:26.834605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:26.836405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:26.901737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:26.903203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:26.913185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1216/2430] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:30.170742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:30.172880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:30.191024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c161ee-cede-4715-8500-d64186c5a596 service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:30.197180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:30.202088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:30.202088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:30.202088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] PATH_INFO: `/v3/users/f4fa2b7534d0498f9e30c382e640c878` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:30.202088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fa2b7534d0498f9e30c382e640c878)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:30.202088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:30.268822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fa2b7534d0498f9e30c382e640c878'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.279160 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fa2b7534d0498f9e30c382e640c878'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.279818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fa2b7534d0498f9e30c382e640c878'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.294405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fa2b7534d0498f9e30c382e640c878'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.294902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4c50203f-a429-48b7-b18a-2ad262ee842c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fa2b7534d0498f9e30c382e640c878'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.309603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1215/2431] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:30 2022] DELETE /identity/v3/users/f4fa2b7534d0498f9e30c382e640c878 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:30.499577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:30.509817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cacda4-4c99-408a-8ef2-015033ad35a8 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:30.568205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:30.568861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:30.569149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:30.569500 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] PATH_INFO: `/v3/projects/30d4d43d5dcf460ab869785d343ca803` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:30.580481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d4d43d5dcf460ab869785d343ca803)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:30.582466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:30.646990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:30.651385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d4d43d5dcf460ab869785d343ca803', 'request_id': 'req-175f252d-06e2-48d8-becd-9566ec669760'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.659358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d4d43d5dcf460ab869785d343ca803', 'request_id': 'req-175f252d-06e2-48d8-becd-9566ec669760'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.665070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d4d43d5dcf460ab869785d343ca803', 'request_id': 'req-175f252d-06e2-48d8-becd-9566ec669760'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.677077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] The token cache is being invalidate because project 30d4d43d5dcf460ab869785d343ca803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:30.677378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.678090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-175f252d-06e2-48d8-becd-9566ec669760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:30.679645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1217/2432] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:30 2022] DELETE /identity/v3/projects/30d4d43d5dcf460ab869785d343ca803 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:30.684854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16b99-3e4a-4742-9c3b-5d7d5fd0bd76 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:30.685079 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16b99-3e4a-4742-9c3b-5d7d5fd0bd76 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:30.685351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16b99-3e4a-4742-9c3b-5d7d5fd0bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:30.705491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e0e16b99-3e4a-4742-9c3b-5d7d5fd0bd76 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:30.706703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e0e16b99-3e4a-4742-9c3b-5d7d5fd0bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:30.766190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1216/2433] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:30.774028 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1220b3-fbac-46fa-886f-8fca9ffe1c3b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:30.774322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1220b3-fbac-46fa-886f-8fca9ffe1c3b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:30.774603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1220b3-fbac-46fa-886f-8fca9ffe1c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:30.794105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1c1220b3-fbac-46fa-886f-8fca9ffe1c3b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:30.795343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c1220b3-fbac-46fa-886f-8fca9ffe1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:30.803953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1218/2434] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:30.808507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e16b99-3e4a-4742-9c3b-5d7d5fd0bd76 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:30.818885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e16b99-3e4a-4742-9c3b-5d7d5fd0bd76 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:30.823520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:30.824144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:30.824432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:30.824714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:30.825414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:47:30.825725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:30.827393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:30.839229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1217/2435] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:47:30.843644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1220b3-fbac-46fa-886f-8fca9ffe1c3b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:30.853053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1220b3-fbac-46fa-886f-8fca9ffe1c3b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:30.858301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c9916-2276-48df-ad1a-b1c2ea41f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:30.859685 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9916-2276-48df-ad1a-b1c2ea41f509 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:30.859973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9916-2276-48df-ad1a-b1c2ea41f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:30.860250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9916-2276-48df-ad1a-b1c2ea41f509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:30.860932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c9916-2276-48df-ad1a-b1c2ea41f509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:30.862881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c9916-2276-48df-ad1a-b1c2ea41f509 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:30.906080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1219/2436] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:30 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:30.907035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:30.918175 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aeec4-d6d7-4a87-a14a-65637a3ecc3b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:30.987241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65e07-1c1f-4b22-bdc8-7c91ab8f06c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:30.988033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e07-1c1f-4b22-bdc8-7c91ab8f06c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:30.988326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e07-1c1f-4b22-bdc8-7c91ab8f06c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:30.988788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e07-1c1f-4b22-bdc8-7c91ab8f06c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:30.989683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a65e07-1c1f-4b22-bdc8-7c91ab8f06c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:30.992225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a65e07-1c1f-4b22-bdc8-7c91ab8f06c3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.003038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:31.020891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1218/2437] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:30 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:31.024974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c9916-2276-48df-ad1a-b1c2ea41f509 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.037412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c9916-2276-48df-ad1a-b1c2ea41f509 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.042364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765febf1-5b63-47a0-b0bb-e476e4715373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.042974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765febf1-5b63-47a0-b0bb-e476e4715373 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.043260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765febf1-5b63-47a0-b0bb-e476e4715373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.043581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765febf1-5b63-47a0-b0bb-e476e4715373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.044292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765febf1-5b63-47a0-b0bb-e476e4715373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.045890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765febf1-5b63-47a0-b0bb-e476e4715373 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.057122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1220/2438] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:31.061299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65e07-1c1f-4b22-bdc8-7c91ab8f06c3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.072184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65e07-1c1f-4b22-bdc8-7c91ab8f06c3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.076743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd869bb-c69f-4c72-89e2-c7dcde8bc81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.077369 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd869bb-c69f-4c72-89e2-c7dcde8bc81f admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.078352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd869bb-c69f-4c72-89e2-c7dcde8bc81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.078627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd869bb-c69f-4c72-89e2-c7dcde8bc81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.079314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd869bb-c69f-4c72-89e2-c7dcde8bc81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.080941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd869bb-c69f-4c72-89e2-c7dcde8bc81f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.091711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1219/2439] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:31.096118 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765febf1-5b63-47a0-b0bb-e476e4715373 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.106251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765febf1-5b63-47a0-b0bb-e476e4715373 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.111210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccafe0-273f-4693-bf32-e7352cb03ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.111913 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccafe0-273f-4693-bf32-e7352cb03ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.112228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccafe0-273f-4693-bf32-e7352cb03ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.112545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccafe0-273f-4693-bf32-e7352cb03ec3 admin admin] PATH_INFO: `/v3/projects/3d5ea8c06ebc42448393f0ea7de4d6fb/users/8415645edd27457798793eb0f3fecff2/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.128390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccafe0-273f-4693-bf32-e7352cb03ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5ea8c06ebc42448393f0ea7de4d6fb, user_id=8415645edd27457798793eb0f3fecff2, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.131069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccafe0-273f-4693-bf32-e7352cb03ec3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.144909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1221/2440] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:31 2022] PUT /identity/v3/projects/3d5ea8c06ebc42448393f0ea7de4d6fb/users/8415645edd27457798793eb0f3fecff2/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:31.156570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe9bd-e5c0-46f5-88e1-ef5d6bbf115b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.156854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe9bd-e5c0-46f5-88e1-ef5d6bbf115b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.157131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe9bd-e5c0-46f5-88e1-ef5d6bbf115b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.186542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-859fe9bd-e5c0-46f5-88e1-ef5d6bbf115b None None] MFA Rules not processed for user `8415645edd27457798793eb0f3fecff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:31.188334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-859fe9bd-e5c0-46f5-88e1-ef5d6bbf115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:31.255486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1220/2441] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:31.259991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccafe0-273f-4693-bf32-e7352cb03ec3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.322862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccafe0-273f-4693-bf32-e7352cb03ec3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.327646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dac287-1ee9-4a2c-8d45-4f084f0dd1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.328273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dac287-1ee9-4a2c-8d45-4f084f0dd1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.328559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dac287-1ee9-4a2c-8d45-4f084f0dd1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.328838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dac287-1ee9-4a2c-8d45-4f084f0dd1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.329519 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dac287-1ee9-4a2c-8d45-4f084f0dd1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.331486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dac287-1ee9-4a2c-8d45-4f084f0dd1b2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.391030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1222/2442] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:31 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:31.395296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe9bd-e5c0-46f5-88e1-ef5d6bbf115b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.406182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe9bd-e5c0-46f5-88e1-ef5d6bbf115b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.464896 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fb717-8522-4eae-b2ce-e1fea2631ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.465577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb717-8522-4eae-b2ce-e1fea2631ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.465888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb717-8522-4eae-b2ce-e1fea2631ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.466192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb717-8522-4eae-b2ce-e1fea2631ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.466863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fb717-8522-4eae-b2ce-e1fea2631ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.469453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fb717-8522-4eae-b2ce-e1fea2631ea5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.489992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1221/2443] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:31 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:47:31.494011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dac287-1ee9-4a2c-8d45-4f084f0dd1b2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.504392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dac287-1ee9-4a2c-8d45-4f084f0dd1b2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.509008 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72276e35-bbe3-4425-b98f-f240c063391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.509621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276e35-bbe3-4425-b98f-f240c063391e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.509904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276e35-bbe3-4425-b98f-f240c063391e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.510188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276e35-bbe3-4425-b98f-f240c063391e admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.510907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72276e35-bbe3-4425-b98f-f240c063391e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.512535 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72276e35-bbe3-4425-b98f-f240c063391e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.523884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1223/2444] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:31.528197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fb717-8522-4eae-b2ce-e1fea2631ea5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.539334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fb717-8522-4eae-b2ce-e1fea2631ea5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.544137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d20e81-2931-4572-8e51-14542aa373f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.544807 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d20e81-2931-4572-8e51-14542aa373f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.545091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d20e81-2931-4572-8e51-14542aa373f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.545369 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d20e81-2931-4572-8e51-14542aa373f6 admin admin] PATH_INFO: `/v3/projects/cbaa76ca86784393a6a0206e14a4d391/users/229fbcc6518042b9884f0b602fe7829b/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.561178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d20e81-2931-4572-8e51-14542aa373f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbaa76ca86784393a6a0206e14a4d391, user_id=229fbcc6518042b9884f0b602fe7829b, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.564028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d20e81-2931-4572-8e51-14542aa373f6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.578004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1222/2445] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:31 2022] PUT /identity/v3/projects/cbaa76ca86784393a6a0206e14a4d391/users/229fbcc6518042b9884f0b602fe7829b/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:31.582241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72276e35-bbe3-4425-b98f-f240c063391e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.592403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72276e35-bbe3-4425-b98f-f240c063391e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.623311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:31.652931 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39916336-03c6-43ab-9685-acfdac6cfe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.653569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39916336-03c6-43ab-9685-acfdac6cfe17 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.653859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39916336-03c6-43ab-9685-acfdac6cfe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.654139 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39916336-03c6-43ab-9685-acfdac6cfe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.654843 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39916336-03c6-43ab-9685-acfdac6cfe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.657040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39916336-03c6-43ab-9685-acfdac6cfe17 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.667030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1224/2446] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:31.671910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d20e81-2931-4572-8e51-14542aa373f6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.682743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d20e81-2931-4572-8e51-14542aa373f6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.687425 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.688096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.688381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.688662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] PATH_INFO: `/v3/projects/cbaa76ca86784393a6a0206e14a4d391/users/229fbcc6518042b9884f0b602fe7829b/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.690610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbaa76ca86784393a6a0206e14a4d391, user_id=229fbcc6518042b9884f0b602fe7829b, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.693439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.703711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1223/2447] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:31 2022] PUT /identity/v3/projects/cbaa76ca86784393a6a0206e14a4d391/users/229fbcc6518042b9884f0b602fe7829b/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:31.714592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fd2c1-4672-49cf-bbc0-43b7fa21ae0b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.714953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fd2c1-4672-49cf-bbc0-43b7fa21ae0b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.715178 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fd2c1-4672-49cf-bbc0-43b7fa21ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.751705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c45fd2c1-4672-49cf-bbc0-43b7fa21ae0b None None] MFA Rules not processed for user `229fbcc6518042b9884f0b602fe7829b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:31.753006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c45fd2c1-4672-49cf-bbc0-43b7fa21ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:31.826896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1225/2448] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:47:31.838951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:31.840745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:31.865132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:31.922625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56749f96-e277-48dd-8b2e-533bab84d097 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:31.926568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2cf75-94cd-4862-a809-5282650aaaca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:31.927303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cf75-94cd-4862-a809-5282650aaaca service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:31.927733 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cf75-94cd-4862-a809-5282650aaaca service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:31.928015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cf75-94cd-4862-a809-5282650aaaca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:31.937982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2cf75-94cd-4862-a809-5282650aaaca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:31.939434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2cf75-94cd-4862-a809-5282650aaaca service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:31.949159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1224/2449] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:32.377495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fd2c1-4672-49cf-bbc0-43b7fa21ae0b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:32.448000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fd2c1-4672-49cf-bbc0-43b7fa21ae0b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:32.453935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:32.455039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:32.455560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:32.455853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] PATH_INFO: `/v3/users/8415645edd27457798793eb0f3fecff2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:32.457389 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8415645edd27457798793eb0f3fecff2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:32.460653 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:32.514335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8415645edd27457798793eb0f3fecff2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:32.522641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8415645edd27457798793eb0f3fecff2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:32.524866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:32.532404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8415645edd27457798793eb0f3fecff2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:32.533556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8415645edd27457798793eb0f3fecff2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:32.546924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8415645edd27457798793eb0f3fecff2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:32.553049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1226/2450] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:32 2022] DELETE /identity/v3/users/8415645edd27457798793eb0f3fecff2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:32.558029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62582-1a6a-4749-b7c7-b75744143806 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:32.558506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62582-1a6a-4749-b7c7-b75744143806 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:32.558628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62582-1a6a-4749-b7c7-b75744143806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:32.579838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4bb62582-1a6a-4749-b7c7-b75744143806 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:32.581295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4bb62582-1a6a-4749-b7c7-b75744143806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:32.644283 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1225/2451] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:32.654148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:32.655762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:32.721737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277966-dab9-460a-8c88-6a3ea35b801a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:32.725910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927f98-1ac1-46b2-bffc-929d8d6cb14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:32.726527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927f98-1ac1-46b2-bffc-929d8d6cb14a service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:32.726814 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927f98-1ac1-46b2-bffc-929d8d6cb14a service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:32.727090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927f98-1ac1-46b2-bffc-929d8d6cb14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:32.738392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca927f98-1ac1-46b2-bffc-929d8d6cb14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:32.739877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca927f98-1ac1-46b2-bffc-929d8d6cb14a service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:32.752697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1227/2452] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:33.027953 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62582-1a6a-4749-b7c7-b75744143806 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:33.029572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4bb62582-1a6a-4749-b7c7-b75744143806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:33.042679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62582-1a6a-4749-b7c7-b75744143806 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:33.047528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:33.048181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:33.048463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:33.048739 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] PATH_INFO: `/v3/projects/3d5ea8c06ebc42448393f0ea7de4d6fb` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:33.049925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5ea8c06ebc42448393f0ea7de4d6fb)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:33.051980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:33.101278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5ea8c06ebc42448393f0ea7de4d6fb', 'request_id': 'req-31d5046a-8adb-444d-bc17-fb025e6015b2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.107431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5ea8c06ebc42448393f0ea7de4d6fb', 'request_id': 'req-31d5046a-8adb-444d-bc17-fb025e6015b2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.113525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5ea8c06ebc42448393f0ea7de4d6fb', 'request_id': 'req-31d5046a-8adb-444d-bc17-fb025e6015b2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.127165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] The token cache is being invalidate because project 3d5ea8c06ebc42448393f0ea7de4d6fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:33.127500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.128114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.129908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1226/2453] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:33 2022] DELETE /identity/v3/projects/3d5ea8c06ebc42448393f0ea7de4d6fb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:33.134113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927f98-1ac1-46b2-bffc-929d8d6cb14a service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:33.143788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927f98-1ac1-46b2-bffc-929d8d6cb14a service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:33.207210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:33.207803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:33.208089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:33.208364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] PATH_INFO: `/v3/users/229fbcc6518042b9884f0b602fe7829b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:33.209652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229fbcc6518042b9884f0b602fe7829b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:33.211821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:33.269291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229fbcc6518042b9884f0b602fe7829b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.277684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229fbcc6518042b9884f0b602fe7829b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.289301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229fbcc6518042b9884f0b602fe7829b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.290090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229fbcc6518042b9884f0b602fe7829b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.305941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:33.307551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1792a669-6158-4f2f-810f-0a1b330adcc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229fbcc6518042b9884f0b602fe7829b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.315314 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1228/2454] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:33 2022] DELETE /identity/v3/users/229fbcc6518042b9884f0b602fe7829b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:33.596019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:33.597475 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:33.616529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5046a-8adb-444d-bc17-fb025e6015b2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:33.644922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:33.677989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:33.678626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:33.678908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:33.679185 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] PATH_INFO: `/v3/projects/cbaa76ca86784393a6a0206e14a4d391` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:33.680632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbaa76ca86784393a6a0206e14a4d391)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:33.682545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:33.728207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbaa76ca86784393a6a0206e14a4d391', 'request_id': 'req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.734756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbaa76ca86784393a6a0206e14a4d391', 'request_id': 'req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.740318 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbaa76ca86784393a6a0206e14a4d391', 'request_id': 'req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.753306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] The token cache is being invalidate because project cbaa76ca86784393a6a0206e14a4d391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:33.753720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.754351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-64fd617b-eed2-40c5-b6a0-6c26a1a3e922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:33.755914 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1227/2455] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:33 2022] DELETE /identity/v3/projects/cbaa76ca86784393a6a0206e14a4d391 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:33.760791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a390cd-0b3f-43c6-9614-96f375c3c891 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:33.761255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a390cd-0b3f-43c6-9614-96f375c3c891 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:33.761387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a390cd-0b3f-43c6-9614-96f375c3c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:33.781954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a1a390cd-0b3f-43c6-9614-96f375c3c891 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:33.783169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a1a390cd-0b3f-43c6-9614-96f375c3c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:33.842753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1229/2456] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:33.851601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf478-4d16-49d6-a252-b4a204aeb4b3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:33.851912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf478-4d16-49d6-a252-b4a204aeb4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:33.852192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf478-4d16-49d6-a252-b4a204aeb4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:33.873065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d34bf478-4d16-49d6-a252-b4a204aeb4b3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:33.874292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d34bf478-4d16-49d6-a252-b4a204aeb4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:33.882296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1228/2457] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:33.886715 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a390cd-0b3f-43c6-9614-96f375c3c891 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:33.896870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a390cd-0b3f-43c6-9614-96f375c3c891 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:33.901491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:33.902107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:33.902383 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:33.902667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:33.903342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:47:33.903680 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:33.905272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:33.917679 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1230/2458] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:47:33.922797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bf478-4d16-49d6-a252-b4a204aeb4b3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:33.932422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bf478-4d16-49d6-a252-b4a204aeb4b3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:33.937434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eed8e-c9c4-4c0b-9a51-d8075dd25726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:33.938296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eed8e-c9c4-4c0b-9a51-d8075dd25726 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:33.938685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eed8e-c9c4-4c0b-9a51-d8075dd25726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:33.939114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eed8e-c9c4-4c0b-9a51-d8075dd25726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:33.939852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1eed8e-c9c4-4c0b-9a51-d8075dd25726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:33.941919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1eed8e-c9c4-4c0b-9a51-d8075dd25726 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:33.977222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1229/2459] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:33 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:33.982402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:33.993198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c3f3c-0fe5-4afa-bde1-ee6f8328d2c8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.049821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443751-85d2-472f-b12c-83fa5592dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.050443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443751-85d2-472f-b12c-83fa5592dc80 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.050730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443751-85d2-472f-b12c-83fa5592dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.051007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443751-85d2-472f-b12c-83fa5592dc80 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.051724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e443751-85d2-472f-b12c-83fa5592dc80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.053643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e443751-85d2-472f-b12c-83fa5592dc80 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.073651 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1231/2460] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:33 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:34.077819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eed8e-c9c4-4c0b-9a51-d8075dd25726 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.088456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eed8e-c9c4-4c0b-9a51-d8075dd25726 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.093262 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf2a84-1016-4b24-9ae9-c321397bd896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.094409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf2a84-1016-4b24-9ae9-c321397bd896 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.094686 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf2a84-1016-4b24-9ae9-c321397bd896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.094956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf2a84-1016-4b24-9ae9-c321397bd896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.095694 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf2a84-1016-4b24-9ae9-c321397bd896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.097285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf2a84-1016-4b24-9ae9-c321397bd896 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.107552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1230/2461] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:34.112164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443751-85d2-472f-b12c-83fa5592dc80 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.122309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443751-85d2-472f-b12c-83fa5592dc80 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.127185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c50d7-a53d-4911-ad5d-b24138191757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.127838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c50d7-a53d-4911-ad5d-b24138191757 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.128127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c50d7-a53d-4911-ad5d-b24138191757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.128412 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c50d7-a53d-4911-ad5d-b24138191757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.129111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c50d7-a53d-4911-ad5d-b24138191757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.130713 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c50d7-a53d-4911-ad5d-b24138191757 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.141727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1232/2462] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:34.146214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf2a84-1016-4b24-9ae9-c321397bd896 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.156788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf2a84-1016-4b24-9ae9-c321397bd896 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.161352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977cccb-6ec4-4388-807d-e87a1df579fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.162018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cccb-6ec4-4388-807d-e87a1df579fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.162301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cccb-6ec4-4388-807d-e87a1df579fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.162578 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cccb-6ec4-4388-807d-e87a1df579fe admin admin] PATH_INFO: `/v3/projects/4fe3336bb4794749a8da764c76115417/users/e11f81ddf71b47e79068ab90c04914d1/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.177380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977cccb-6ec4-4388-807d-e87a1df579fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe3336bb4794749a8da764c76115417, user_id=e11f81ddf71b47e79068ab90c04914d1, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.180068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977cccb-6ec4-4388-807d-e87a1df579fe admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.192725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1231/2463] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:34 2022] PUT /identity/v3/projects/4fe3336bb4794749a8da764c76115417/users/e11f81ddf71b47e79068ab90c04914d1/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:34.204285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daabeb-21e9-4f22-8db2-c541ef409c15 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.204607 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daabeb-21e9-4f22-8db2-c541ef409c15 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.205125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daabeb-21e9-4f22-8db2-c541ef409c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.235321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b9daabeb-21e9-4f22-8db2-c541ef409c15 None None] MFA Rules not processed for user `e11f81ddf71b47e79068ab90c04914d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:34.236503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b9daabeb-21e9-4f22-8db2-c541ef409c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:34.287982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:34.305960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1233/2464] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:34.310507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977cccb-6ec4-4388-807d-e87a1df579fe admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.362691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:34.374828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977cccb-6ec4-4388-807d-e87a1df579fe admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.379894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45907ea-b3d6-4615-9f12-77e1cd425ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.380522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45907ea-b3d6-4615-9f12-77e1cd425ace admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.380802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45907ea-b3d6-4615-9f12-77e1cd425ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.381078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45907ea-b3d6-4615-9f12-77e1cd425ace admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.381743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45907ea-b3d6-4615-9f12-77e1cd425ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.383679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45907ea-b3d6-4615-9f12-77e1cd425ace admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.411769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1232/2465] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:34 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:34.415904 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daabeb-21e9-4f22-8db2-c541ef409c15 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.426590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daabeb-21e9-4f22-8db2-c541ef409c15 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.485770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256694-af64-4d27-a39d-c3b594697b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.486308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256694-af64-4d27-a39d-c3b594697b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.486590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256694-af64-4d27-a39d-c3b594697b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.486868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256694-af64-4d27-a39d-c3b594697b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.487559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44256694-af64-4d27-a39d-c3b594697b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.489470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44256694-af64-4d27-a39d-c3b594697b68 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.510220 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1234/2466] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:34 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:34.514270 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45907ea-b3d6-4615-9f12-77e1cd425ace admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.525883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45907ea-b3d6-4615-9f12-77e1cd425ace admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.530463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eee4b-3c87-447b-9d81-ce910cbecee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.531115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eee4b-3c87-447b-9d81-ce910cbecee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.531993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eee4b-3c87-447b-9d81-ce910cbecee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.532263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eee4b-3c87-447b-9d81-ce910cbecee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.532947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eee4b-3c87-447b-9d81-ce910cbecee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.534582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eee4b-3c87-447b-9d81-ce910cbecee0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.545101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1233/2467] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:34.549708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256694-af64-4d27-a39d-c3b594697b68 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.560264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256694-af64-4d27-a39d-c3b594697b68 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.564910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964e7a2-c1af-4c60-a996-825d7dcebc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.565572 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964e7a2-c1af-4c60-a996-825d7dcebc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.565861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964e7a2-c1af-4c60-a996-825d7dcebc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.566140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964e7a2-c1af-4c60-a996-825d7dcebc34 admin admin] PATH_INFO: `/v3/projects/f0ec6c83c84746418b089c91c6f7e74d/users/caf1f2d901ed4d049cf86082790e74ae/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.581877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964e7a2-c1af-4c60-a996-825d7dcebc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ec6c83c84746418b089c91c6f7e74d, user_id=caf1f2d901ed4d049cf86082790e74ae, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.584628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964e7a2-c1af-4c60-a996-825d7dcebc34 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.599142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1235/2468] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:34 2022] PUT /identity/v3/projects/f0ec6c83c84746418b089c91c6f7e74d/users/caf1f2d901ed4d049cf86082790e74ae/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:34.603036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eee4b-3c87-447b-9d81-ce910cbecee0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.613290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eee4b-3c87-447b-9d81-ce910cbecee0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.671519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875123d1-6f21-4d79-9e1a-35e823572730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.672144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875123d1-6f21-4d79-9e1a-35e823572730 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.672428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875123d1-6f21-4d79-9e1a-35e823572730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.672707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875123d1-6f21-4d79-9e1a-35e823572730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.673399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875123d1-6f21-4d79-9e1a-35e823572730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.675024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875123d1-6f21-4d79-9e1a-35e823572730 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.685289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1234/2469] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:34.689984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964e7a2-c1af-4c60-a996-825d7dcebc34 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.700237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964e7a2-c1af-4c60-a996-825d7dcebc34 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.705473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.706131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.706418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.706700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] PATH_INFO: `/v3/projects/f0ec6c83c84746418b089c91c6f7e74d/users/caf1f2d901ed4d049cf86082790e74ae/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.708720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ec6c83c84746418b089c91c6f7e74d, user_id=caf1f2d901ed4d049cf86082790e74ae, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.711401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.722083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1236/2470] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:34 2022] PUT /identity/v3/projects/f0ec6c83c84746418b089c91c6f7e74d/users/caf1f2d901ed4d049cf86082790e74ae/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:34.733368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f969d0-8e86-451b-98a8-1fa6ba65dd46 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.733741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f969d0-8e86-451b-98a8-1fa6ba65dd46 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.734276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f969d0-8e86-451b-98a8-1fa6ba65dd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.768997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f6f969d0-8e86-451b-98a8-1fa6ba65dd46 None None] MFA Rules not processed for user `caf1f2d901ed4d049cf86082790e74ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:34.770319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f6f969d0-8e86-451b-98a8-1fa6ba65dd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:34.842786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1235/2471] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:34.854850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:34.858597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:34.921153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67f0e-7257-4729-95fd-15a02a66ddcf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:34.925048 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d167b-8b5a-4510-ae91-1f4b695a2763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:34.925682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d167b-8b5a-4510-ae91-1f4b695a2763 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:34.925965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d167b-8b5a-4510-ae91-1f4b695a2763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:34.926239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d167b-8b5a-4510-ae91-1f4b695a2763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:34.942849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d167b-8b5a-4510-ae91-1f4b695a2763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:34.944470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d167b-8b5a-4510-ae91-1f4b695a2763 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:34.958410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1237/2472] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:34.991787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f969d0-8e86-451b-98a8-1fa6ba65dd46 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:35.053701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:35.074968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f969d0-8e86-451b-98a8-1fa6ba65dd46 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:35.080236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:35.080901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:35.081191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:35.081455 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] PATH_INFO: `/v3/users/e11f81ddf71b47e79068ab90c04914d1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:35.082679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11f81ddf71b47e79068ab90c04914d1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:35.084860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:35.139358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11f81ddf71b47e79068ab90c04914d1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.147184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11f81ddf71b47e79068ab90c04914d1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.147933 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11f81ddf71b47e79068ab90c04914d1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.163403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11f81ddf71b47e79068ab90c04914d1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.164592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11f81ddf71b47e79068ab90c04914d1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.182424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1236/2473] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:34 2022] DELETE /identity/v3/users/e11f81ddf71b47e79068ab90c04914d1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:35.186910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a2a3-ac1e-4021-8327-fd33e27add57 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:35.187271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a2a3-ac1e-4021-8327-fd33e27add57 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:35.188202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a2a3-ac1e-4021-8327-fd33e27add57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:35.207628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0d71a2a3-ac1e-4021-8327-fd33e27add57 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:35.208860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0d71a2a3-ac1e-4021-8327-fd33e27add57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:35.265231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:35.284504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1238/2474] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:47:35.294350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:35.296294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:35.363246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455aa0a-92e3-4c43-badc-d1c9f789b974 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:35.366974 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101e0a-9c51-47d0-bff3-ce12c64eb95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:35.367713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101e0a-9c51-47d0-bff3-ce12c64eb95f service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:35.367998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101e0a-9c51-47d0-bff3-ce12c64eb95f service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:35.368276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101e0a-9c51-47d0-bff3-ce12c64eb95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:35.381134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101e0a-9c51-47d0-bff3-ce12c64eb95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:35.382613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101e0a-9c51-47d0-bff3-ce12c64eb95f service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:35.396487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1237/2475] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:35.665291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a2a3-ac1e-4021-8327-fd33e27add57 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:35.666747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0d71a2a3-ac1e-4021-8327-fd33e27add57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:35.679573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a2a3-ac1e-4021-8327-fd33e27add57 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:35.684703 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:35.685402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:35.685681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:35.685952 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] PATH_INFO: `/v3/projects/4fe3336bb4794749a8da764c76115417` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:35.687106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe3336bb4794749a8da764c76115417)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:35.689724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:35.737125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe3336bb4794749a8da764c76115417', 'request_id': 'req-444f055b-ae4b-4f87-9e3e-0404d20e83f6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.745040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe3336bb4794749a8da764c76115417', 'request_id': 'req-444f055b-ae4b-4f87-9e3e-0404d20e83f6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.750639 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe3336bb4794749a8da764c76115417', 'request_id': 'req-444f055b-ae4b-4f87-9e3e-0404d20e83f6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.761300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] The token cache is being invalidate because project 4fe3336bb4794749a8da764c76115417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:35.761587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.762209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.763747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1239/2476] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:35 2022] DELETE /identity/v3/projects/4fe3336bb4794749a8da764c76115417 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:35.768273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101e0a-9c51-47d0-bff3-ce12c64eb95f service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:35.777714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101e0a-9c51-47d0-bff3-ce12c64eb95f service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:35.834645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:35.835277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:35.835584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:35.835855 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] PATH_INFO: `/v3/users/caf1f2d901ed4d049cf86082790e74ae` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:35.837195 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf1f2d901ed4d049cf86082790e74ae)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:35.839292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:35.851593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:35.888289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf1f2d901ed4d049cf86082790e74ae'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.895580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf1f2d901ed4d049cf86082790e74ae'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.896218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf1f2d901ed4d049cf86082790e74ae'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.908910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf1f2d901ed4d049cf86082790e74ae'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.909489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-365e3938-56c8-45f5-a9f0-1ccfdc3b7483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf1f2d901ed4d049cf86082790e74ae'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:35.922521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1238/2477] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:35 2022] DELETE /identity/v3/users/caf1f2d901ed4d049cf86082790e74ae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:36.196459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:36.198024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:36.215160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f055b-ae4b-4f87-9e3e-0404d20e83f6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:36.276237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:36.276876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.277157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.277431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] PATH_INFO: `/v3/projects/f0ec6c83c84746418b089c91c6f7e74d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.278579 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ec6c83c84746418b089c91c6f7e74d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:36.280613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:36.326888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ec6c83c84746418b089c91c6f7e74d', 'request_id': 'req-1da94faf-96b1-45fb-862a-a3c28af5a0bd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:36.333850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ec6c83c84746418b089c91c6f7e74d', 'request_id': 'req-1da94faf-96b1-45fb-862a-a3c28af5a0bd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:36.339475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ec6c83c84746418b089c91c6f7e74d', 'request_id': 'req-1da94faf-96b1-45fb-862a-a3c28af5a0bd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:36.347543 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:36.352406 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] The token cache is being invalidate because project f0ec6c83c84746418b089c91c6f7e74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:36.352838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:36.353903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1da94faf-96b1-45fb-862a-a3c28af5a0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:36.356083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1240/2478] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:36 2022] DELETE /identity/v3/projects/f0ec6c83c84746418b089c91c6f7e74d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:36.361689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e86f8-979b-4671-bbc2-7981262041d2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.361965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e86f8-979b-4671-bbc2-7981262041d2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.362247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e86f8-979b-4671-bbc2-7981262041d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.381691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a04e86f8-979b-4671-bbc2-7981262041d2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:36.382885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a04e86f8-979b-4671-bbc2-7981262041d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:36.441293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1239/2479] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:36.449119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743a550-4788-4ef9-8a21-9a0ee258416f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.449399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743a550-4788-4ef9-8a21-9a0ee258416f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.449682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743a550-4788-4ef9-8a21-9a0ee258416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.469602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e743a550-4788-4ef9-8a21-9a0ee258416f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:36.470810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e743a550-4788-4ef9-8a21-9a0ee258416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:36.478749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1241/2480] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:36.482932 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e86f8-979b-4671-bbc2-7981262041d2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:36.503424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e86f8-979b-4671-bbc2-7981262041d2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:36.510018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:36.510646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.510930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.511204 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.511941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:47:36.512246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:36.513861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:36.526691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1240/2481] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:47:36.531049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743a550-4788-4ef9-8a21-9a0ee258416f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:36.540833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743a550-4788-4ef9-8a21-9a0ee258416f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:36.545422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7e6d-a16a-43c3-a3c3-2cb25162fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:36.546024 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7e6d-a16a-43c3-a3c3-2cb25162fa93 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.546306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7e6d-a16a-43c3-a3c3-2cb25162fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.546628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7e6d-a16a-43c3-a3c3-2cb25162fa93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.547300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c7e6d-a16a-43c3-a3c3-2cb25162fa93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:36.549224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c7e6d-a16a-43c3-a3c3-2cb25162fa93 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:36.575953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1242/2482] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:36 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:36.580680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:36.590844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a5531-b511-4f51-82ef-115c9f25bc51 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:36.648668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68193e7-eec4-4e99-812e-8c6323ed301d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:36.649299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68193e7-eec4-4e99-812e-8c6323ed301d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.649584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68193e7-eec4-4e99-812e-8c6323ed301d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.649862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68193e7-eec4-4e99-812e-8c6323ed301d admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.650537 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68193e7-eec4-4e99-812e-8c6323ed301d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:36.652529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68193e7-eec4-4e99-812e-8c6323ed301d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:36.674043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1241/2483] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:36 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:47:36.678190 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7e6d-a16a-43c3-a3c3-2cb25162fa93 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:36.688834 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7e6d-a16a-43c3-a3c3-2cb25162fa93 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:36.693533 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9faab-039f-415d-bf37-44610d391edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:36.694306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9faab-039f-415d-bf37-44610d391edc admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.694683 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9faab-039f-415d-bf37-44610d391edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.695052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9faab-039f-415d-bf37-44610d391edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.695921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9faab-039f-415d-bf37-44610d391edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:36.697706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9faab-039f-415d-bf37-44610d391edc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:36.708372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1243/2484] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:36.711995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68193e7-eec4-4e99-812e-8c6323ed301d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:36.722630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68193e7-eec4-4e99-812e-8c6323ed301d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:36.727320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d317e-0eab-4106-bfba-5f40ae1a57bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:36.727968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d317e-0eab-4106-bfba-5f40ae1a57bb admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.728274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d317e-0eab-4106-bfba-5f40ae1a57bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.728714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d317e-0eab-4106-bfba-5f40ae1a57bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.729668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d317e-0eab-4106-bfba-5f40ae1a57bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:36.731281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d317e-0eab-4106-bfba-5f40ae1a57bb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:36.732646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:36.744685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1242/2485] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:36.748847 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9faab-039f-415d-bf37-44610d391edc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:36.758892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9faab-039f-415d-bf37-44610d391edc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:36.763736 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e13bf-a1cb-40c9-8a56-e578daf9e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:36.764407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e13bf-a1cb-40c9-8a56-e578daf9e6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.764724 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e13bf-a1cb-40c9-8a56-e578daf9e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.765005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e13bf-a1cb-40c9-8a56-e578daf9e6a3 admin admin] PATH_INFO: `/v3/projects/acd01f84fc7d4bcebad7bb9565a69382/users/39a58e1f49fc4300a1dfef9729438abe/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.780040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e13bf-a1cb-40c9-8a56-e578daf9e6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd01f84fc7d4bcebad7bb9565a69382, user_id=39a58e1f49fc4300a1dfef9729438abe, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:36.783522 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e13bf-a1cb-40c9-8a56-e578daf9e6a3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:36.796503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1244/2486] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:36 2022] PUT /identity/v3/projects/acd01f84fc7d4bcebad7bb9565a69382/users/39a58e1f49fc4300a1dfef9729438abe/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:36.809507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006785-9474-443f-a8c1-5936639e91d6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.810027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006785-9474-443f-a8c1-5936639e91d6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.810133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006785-9474-443f-a8c1-5936639e91d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.839394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8f006785-9474-443f-a8c1-5936639e91d6 None None] MFA Rules not processed for user `39a58e1f49fc4300a1dfef9729438abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:36.840646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8f006785-9474-443f-a8c1-5936639e91d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:36.909236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1243/2487] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:36.913854 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e13bf-a1cb-40c9-8a56-e578daf9e6a3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:36.979421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e13bf-a1cb-40c9-8a56-e578daf9e6a3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:36.984240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5a967-469a-4da4-b700-ff05f883510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:36.984864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a967-469a-4da4-b700-ff05f883510a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:36.985147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a967-469a-4da4-b700-ff05f883510a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:36.985443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a967-469a-4da4-b700-ff05f883510a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:36.986098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a967-469a-4da4-b700-ff05f883510a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:36.988049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a967-469a-4da4-b700-ff05f883510a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:37.016991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1245/2488] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:36 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:37.021134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f006785-9474-443f-a8c1-5936639e91d6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:37.032338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f006785-9474-443f-a8c1-5936639e91d6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:37.089245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90381-41df-41a5-8588-e096dfe40a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:37.089874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90381-41df-41a5-8588-e096dfe40a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:37.090158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90381-41df-41a5-8588-e096dfe40a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:37.090433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90381-41df-41a5-8588-e096dfe40a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:37.091107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b90381-41df-41a5-8588-e096dfe40a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:37.093067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b90381-41df-41a5-8588-e096dfe40a69 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:37.114040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1244/2489] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:37 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:37.118063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5a967-469a-4da4-b700-ff05f883510a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:37.129056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5a967-469a-4da4-b700-ff05f883510a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:37.133618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf30a31-004b-4b76-a3d2-66305809dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:37.134223 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30a31-004b-4b76-a3d2-66305809dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:37.134503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30a31-004b-4b76-a3d2-66305809dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:37.134775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30a31-004b-4b76-a3d2-66305809dc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:37.135490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf30a31-004b-4b76-a3d2-66305809dc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:37.137104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf30a31-004b-4b76-a3d2-66305809dc00 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:37.148292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1246/2490] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:37.152580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90381-41df-41a5-8588-e096dfe40a69 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:37.163008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90381-41df-41a5-8588-e096dfe40a69 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:37.167657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3a0f8-60dd-4b4b-b6bc-d869ae58f386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:37.168327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3a0f8-60dd-4b4b-b6bc-d869ae58f386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:37.168608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3a0f8-60dd-4b4b-b6bc-d869ae58f386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:37.168888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3a0f8-60dd-4b4b-b6bc-d869ae58f386 admin admin] PATH_INFO: `/v3/projects/ff26f00cfa51473bbb1a6b0d7a5c9fd8/users/ed7e9858cc674c13b433361f60396a21/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:37.186917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3a0f8-60dd-4b4b-b6bc-d869ae58f386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff26f00cfa51473bbb1a6b0d7a5c9fd8, user_id=ed7e9858cc674c13b433361f60396a21, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:37.190189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3a0f8-60dd-4b4b-b6bc-d869ae58f386 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:37.207235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1245/2491] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:37 2022] PUT /identity/v3/projects/ff26f00cfa51473bbb1a6b0d7a5c9fd8/users/ed7e9858cc674c13b433361f60396a21/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:37.211443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf30a31-004b-4b76-a3d2-66305809dc00 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:37.222154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf30a31-004b-4b76-a3d2-66305809dc00 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:37.286442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859861f-9b03-405d-97a2-34e65230419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:37.287067 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859861f-9b03-405d-97a2-34e65230419b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:37.287349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859861f-9b03-405d-97a2-34e65230419b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:37.287670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859861f-9b03-405d-97a2-34e65230419b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:37.288343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859861f-9b03-405d-97a2-34e65230419b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:37.289948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859861f-9b03-405d-97a2-34e65230419b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:37.300011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1247/2492] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:37.304368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3a0f8-60dd-4b4b-b6bc-d869ae58f386 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:37.315341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3a0f8-60dd-4b4b-b6bc-d869ae58f386 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:37.322300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:37.323008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:37.323285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:37.323609 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] PATH_INFO: `/v3/projects/ff26f00cfa51473bbb1a6b0d7a5c9fd8/users/ed7e9858cc674c13b433361f60396a21/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:37.325870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff26f00cfa51473bbb1a6b0d7a5c9fd8, user_id=ed7e9858cc674c13b433361f60396a21, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:37.329143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:37.340323 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1246/2493] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:37 2022] PUT /identity/v3/projects/ff26f00cfa51473bbb1a6b0d7a5c9fd8/users/ed7e9858cc674c13b433361f60396a21/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:37.351493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994ea5b-df6b-495e-80de-096c0b08490f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:37.351849 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994ea5b-df6b-495e-80de-096c0b08490f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:37.352217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994ea5b-df6b-495e-80de-096c0b08490f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:37.368173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:37.383979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0994ea5b-df6b-495e-80de-096c0b08490f None None] MFA Rules not processed for user `ed7e9858cc674c13b433361f60396a21`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:37.385231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0994ea5b-df6b-495e-80de-096c0b08490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:37.458172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1248/2494] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:37.470568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:37.472466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:37.514123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:37.530692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d83c-98d4-41bc-9056-918352b5a131 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:37.534930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028095a-f674-4e6c-a3a1-d503b30625ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:37.535581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028095a-f674-4e6c-a3a1-d503b30625ab service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:37.535859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028095a-f674-4e6c-a3a1-d503b30625ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:37.536130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028095a-f674-4e6c-a3a1-d503b30625ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:37.590819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028095a-f674-4e6c-a3a1-d503b30625ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:37.592285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028095a-f674-4e6c-a3a1-d503b30625ab service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:37.601676 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1247/2495] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:38.954922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994ea5b-df6b-495e-80de-096c0b08490f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:38.956358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0994ea5b-df6b-495e-80de-096c0b08490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:38.968456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994ea5b-df6b-495e-80de-096c0b08490f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:38.972731 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6664b-bd20-4a1c-9757-20375bf9d4e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:38.973343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6664b-bd20-4a1c-9757-20375bf9d4e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:38.973628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6664b-bd20-4a1c-9757-20375bf9d4e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:38.973906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6664b-bd20-4a1c-9757-20375bf9d4e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:38.982955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6664b-bd20-4a1c-9757-20375bf9d4e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:38.984416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6664b-bd20-4a1c-9757-20375bf9d4e8 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:38.993983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1249/2496] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:42.830409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028095a-f674-4e6c-a3a1-d503b30625ab service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:42.896576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028095a-f674-4e6c-a3a1-d503b30625ab service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:42.901100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:42.901738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:42.902016 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:42.902287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] PATH_INFO: `/v3/users/39a58e1f49fc4300a1dfef9729438abe` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:42.903464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a58e1f49fc4300a1dfef9729438abe)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:42.905388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:42.951689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a58e1f49fc4300a1dfef9729438abe'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:42.959630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a58e1f49fc4300a1dfef9729438abe'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:42.960280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a58e1f49fc4300a1dfef9729438abe'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:42.972286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a58e1f49fc4300a1dfef9729438abe'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:42.972925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a58e1f49fc4300a1dfef9729438abe'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:42.985254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1248/2497] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:42 2022] DELETE /identity/v3/users/39a58e1f49fc4300a1dfef9729438abe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:42.989790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880b451-6300-4e0d-8347-6b9a5f9cd0a5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:42.990251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880b451-6300-4e0d-8347-6b9a5f9cd0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:42.990348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880b451-6300-4e0d-8347-6b9a5f9cd0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:43.009503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e880b451-6300-4e0d-8347-6b9a5f9cd0a5 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:43.010717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e880b451-6300-4e0d-8347-6b9a5f9cd0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:43.070321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1250/2498] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:43.080690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:43.082100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:43.095753 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:43.142636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb53f7c-609b-444d-99be-c1f0ee461e53 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:43.146351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96723d18-a178-4a38-be85-82111f2754a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:43.146999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723d18-a178-4a38-be85-82111f2754a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:43.147280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723d18-a178-4a38-be85-82111f2754a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:43.147586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723d18-a178-4a38-be85-82111f2754a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:43.156613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96723d18-a178-4a38-be85-82111f2754a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:43.158082 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96723d18-a178-4a38-be85-82111f2754a2 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:43.167533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1249/2499] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:43.436557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880b451-6300-4e0d-8347-6b9a5f9cd0a5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:43.438900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e880b451-6300-4e0d-8347-6b9a5f9cd0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:43.458544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880b451-6300-4e0d-8347-6b9a5f9cd0a5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:43.465194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:43.466058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:43.466413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:43.466797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] PATH_INFO: `/v3/projects/acd01f84fc7d4bcebad7bb9565a69382` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:43.468143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd01f84fc7d4bcebad7bb9565a69382)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:43.470185 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:43.520348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd01f84fc7d4bcebad7bb9565a69382', 'request_id': 'req-3873834b-f527-40ae-a41c-1f7a1601d333'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.528501 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd01f84fc7d4bcebad7bb9565a69382', 'request_id': 'req-3873834b-f527-40ae-a41c-1f7a1601d333'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.542856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd01f84fc7d4bcebad7bb9565a69382', 'request_id': 'req-3873834b-f527-40ae-a41c-1f7a1601d333'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.558406 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] The token cache is being invalidate because project acd01f84fc7d4bcebad7bb9565a69382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:43.558704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.559402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.561144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1251/2500] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:43 2022] DELETE /identity/v3/projects/acd01f84fc7d4bcebad7bb9565a69382 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:43.566361 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96723d18-a178-4a38-be85-82111f2754a2 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:43.577581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96723d18-a178-4a38-be85-82111f2754a2 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:43.586021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:43.587697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:43.595196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:43.650888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:43.651587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:43.651930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:43.652213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] PATH_INFO: `/v3/users/ed7e9858cc674c13b433361f60396a21` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:43.653498 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7e9858cc674c13b433361f60396a21)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:43.657092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:43.660838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873834b-f527-40ae-a41c-1f7a1601d333 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:43.665666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0f79e-7006-4fc6-8971-ac3b52773cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:43.666205 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0f79e-7006-4fc6-8971-ac3b52773cfe service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:43.666517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0f79e-7006-4fc6-8971-ac3b52773cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:43.666800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0f79e-7006-4fc6-8971-ac3b52773cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:43.668614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-84d0f79e-7006-4fc6-8971-ac3b52773cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:43.710384 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7e9858cc674c13b433361f60396a21'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.721393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7e9858cc674c13b433361f60396a21'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.723096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7e9858cc674c13b433361f60396a21'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.742915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7e9858cc674c13b433361f60396a21'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.743775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7e9858cc674c13b433361f60396a21'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:43.758775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1250/2501] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:43 2022] DELETE /identity/v3/users/ed7e9858cc674c13b433361f60396a21 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:43.766371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0f79e-7006-4fc6-8971-ac3b52773cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:43.767858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0f79e-7006-4fc6-8971-ac3b52773cfe service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:43.791414 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1252/2502] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:47:44.148526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.150010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:44.191035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:44.221486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8125754-0ca2-4004-99be-1a74ae0f4f2d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:44.226023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:44.226659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.226943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.227222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] PATH_INFO: `/v3/projects/ff26f00cfa51473bbb1a6b0d7a5c9fd8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.228402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff26f00cfa51473bbb1a6b0d7a5c9fd8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:44.230364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:44.283774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff26f00cfa51473bbb1a6b0d7a5c9fd8', 'request_id': 'req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:44.290923 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff26f00cfa51473bbb1a6b0d7a5c9fd8', 'request_id': 'req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:44.298241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff26f00cfa51473bbb1a6b0d7a5c9fd8', 'request_id': 'req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:44.311757 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] The token cache is being invalidate because project ff26f00cfa51473bbb1a6b0d7a5c9fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:44.312226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:44.313405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bbeabfaf-4e67-4fb9-ad56-d212e3a30d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:44.314937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1251/2503] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:44 2022] DELETE /identity/v3/projects/ff26f00cfa51473bbb1a6b0d7a5c9fd8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:44.320238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969c44d-28c6-4e22-8d31-c64b9d00acc2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.320738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969c44d-28c6-4e22-8d31-c64b9d00acc2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.320857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969c44d-28c6-4e22-8d31-c64b9d00acc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.340602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4969c44d-28c6-4e22-8d31-c64b9d00acc2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:44.341802 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4969c44d-28c6-4e22-8d31-c64b9d00acc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:44.402419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1253/2504] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:44.411740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ecd7-43cb-4972-bfc5-de9aee0366eb None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.412028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ecd7-43cb-4972-bfc5-de9aee0366eb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.412342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ecd7-43cb-4972-bfc5-de9aee0366eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.437289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-09e9ecd7-43cb-4972-bfc5-de9aee0366eb None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:44.438516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-09e9ecd7-43cb-4972-bfc5-de9aee0366eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:44.446591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1252/2505] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:44.450924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969c44d-28c6-4e22-8d31-c64b9d00acc2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.460784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969c44d-28c6-4e22-8d31-c64b9d00acc2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:44.465389 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:44.466000 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.466286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.466563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.467263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:47:44.467623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:44.469759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:44.481335 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1254/2506] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:47:44.486301 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ecd7-43cb-4972-bfc5-de9aee0366eb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.495635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ecd7-43cb-4972-bfc5-de9aee0366eb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:44.500328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797132dd-9c96-4569-95d7-82784eac7ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:44.500935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797132dd-9c96-4569-95d7-82784eac7ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.501216 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797132dd-9c96-4569-95d7-82784eac7ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.501491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797132dd-9c96-4569-95d7-82784eac7ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.502153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797132dd-9c96-4569-95d7-82784eac7ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:44.504100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797132dd-9c96-4569-95d7-82784eac7ba2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:44.532033 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1253/2507] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:44 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:44.536290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.547315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000229cc-4166-4ce8-8898-461f83acbe6a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:44.555835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:44.615403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553742fc-c012-4b46-ba22-b0b08d7448fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:44.616049 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553742fc-c012-4b46-ba22-b0b08d7448fb admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.616328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553742fc-c012-4b46-ba22-b0b08d7448fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.616605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553742fc-c012-4b46-ba22-b0b08d7448fb admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.617285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553742fc-c012-4b46-ba22-b0b08d7448fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:44.619225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553742fc-c012-4b46-ba22-b0b08d7448fb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:44.639960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1255/2508] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:44 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:44.644203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797132dd-9c96-4569-95d7-82784eac7ba2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.654701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797132dd-9c96-4569-95d7-82784eac7ba2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:44.659893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc3f14-b679-4a81-a121-27314983dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:44.660511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc3f14-b679-4a81-a121-27314983dbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.660794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc3f14-b679-4a81-a121-27314983dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.661072 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc3f14-b679-4a81-a121-27314983dbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.661765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc3f14-b679-4a81-a121-27314983dbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:44.663363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc3f14-b679-4a81-a121-27314983dbf5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:44.674798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1254/2509] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:44.680594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553742fc-c012-4b46-ba22-b0b08d7448fb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.690753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553742fc-c012-4b46-ba22-b0b08d7448fb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:44.695570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d38628-5b5b-4ec9-8332-b74566f17eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:44.696183 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d38628-5b5b-4ec9-8332-b74566f17eea admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.696591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d38628-5b5b-4ec9-8332-b74566f17eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.696873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d38628-5b5b-4ec9-8332-b74566f17eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.697565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d38628-5b5b-4ec9-8332-b74566f17eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:44.699189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d38628-5b5b-4ec9-8332-b74566f17eea admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:44.709856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1256/2510] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:44.713990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc3f14-b679-4a81-a121-27314983dbf5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.724405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc3f14-b679-4a81-a121-27314983dbf5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:44.729020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e181-9beb-4bad-a8fd-1275d870a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:44.729680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e181-9beb-4bad-a8fd-1275d870a814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.729994 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e181-9beb-4bad-a8fd-1275d870a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.730276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e181-9beb-4bad-a8fd-1275d870a814 admin admin] PATH_INFO: `/v3/projects/9f01c4a3b51243b4ac848e302e6d2277/users/884488642e98409480879bf6ccfe98fc/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.746590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62e181-9beb-4bad-a8fd-1275d870a814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f01c4a3b51243b4ac848e302e6d2277, user_id=884488642e98409480879bf6ccfe98fc, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:44.749305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62e181-9beb-4bad-a8fd-1275d870a814 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:44.761611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1255/2511] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:44 2022] PUT /identity/v3/projects/9f01c4a3b51243b4ac848e302e6d2277/users/884488642e98409480879bf6ccfe98fc/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:44.772249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5c81-1248-4a45-bd77-902fd19eaf02 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.772542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5c81-1248-4a45-bd77-902fd19eaf02 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.772825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5c81-1248-4a45-bd77-902fd19eaf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.802300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8d9b5c81-1248-4a45-bd77-902fd19eaf02 None None] MFA Rules not processed for user `884488642e98409480879bf6ccfe98fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:44.803725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8d9b5c81-1248-4a45-bd77-902fd19eaf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:44.869227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1257/2512] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:44.873880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e181-9beb-4bad-a8fd-1275d870a814 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.938209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e181-9beb-4bad-a8fd-1275d870a814 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:44.942797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:44.943586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:44.943875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:44.944155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:44.944820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:44.946754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:44.951215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:44.982416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1256/2513] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:44 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:44.986474 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5c81-1248-4a45-bd77-902fd19eaf02 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:44.997219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5c81-1248-4a45-bd77-902fd19eaf02 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:45.056922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72982-473f-4dbd-b5fe-c00b8a2847b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:45.057550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72982-473f-4dbd-b5fe-c00b8a2847b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.057835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72982-473f-4dbd-b5fe-c00b8a2847b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.058252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72982-473f-4dbd-b5fe-c00b8a2847b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.058933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad72982-473f-4dbd-b5fe-c00b8a2847b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:45.060896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad72982-473f-4dbd-b5fe-c00b8a2847b2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:45.066403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:45.068664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:45.086974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1258/2514] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:44 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:47:45.088075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72982-473f-4dbd-b5fe-c00b8a2847b2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:45.098092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72982-473f-4dbd-b5fe-c00b8a2847b2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:45.103210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3976-150a-443e-967f-80e9e6369e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:45.103845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3976-150a-443e-967f-80e9e6369e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.104153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3976-150a-443e-967f-80e9e6369e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.104427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3976-150a-443e-967f-80e9e6369e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.105116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3976-150a-443e-967f-80e9e6369e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:45.106924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3976-150a-443e-967f-80e9e6369e09 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:45.109221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:45.119777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1259/2515] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:45.122893 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3976-150a-443e-967f-80e9e6369e09 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:45.131667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eb5bf-804b-4ae9-8665-d14433b9f7d9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:45.133342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3976-150a-443e-967f-80e9e6369e09 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:45.135607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:45.136233 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.136525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.136802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.138664 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:45.139646 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c01a7-1652-47b1-a110-7b9af738762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:45.141321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c01a7-1652-47b1-a110-7b9af738762c admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.141739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c01a7-1652-47b1-a110-7b9af738762c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.142148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c01a7-1652-47b1-a110-7b9af738762c admin admin] PATH_INFO: `/v3/projects/3b1698ae9c7a47e79beda69ccee15afa/users/b31915d283a94937be1cf22b2780a8f2/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.167017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c01a7-1652-47b1-a110-7b9af738762c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1698ae9c7a47e79beda69ccee15afa, user_id=b31915d283a94937be1cf22b2780a8f2, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:45.169730 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c01a7-1652-47b1-a110-7b9af738762c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:45.183857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1260/2516] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:45 2022] PUT /identity/v3/projects/3b1698ae9c7a47e79beda69ccee15afa/users/b31915d283a94937be1cf22b2780a8f2/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:45.189977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c01a7-1652-47b1-a110-7b9af738762c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:45.217786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:45.219796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:45.230819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1257/2517] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:47:45.257961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c01a7-1652-47b1-a110-7b9af738762c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:45.262657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63de71-491e-4aef-b658-927c472985ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:45.263291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63de71-491e-4aef-b658-927c472985ea admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.263607 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63de71-491e-4aef-b658-927c472985ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.263889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63de71-491e-4aef-b658-927c472985ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.264587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63de71-491e-4aef-b658-927c472985ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:45.266200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63de71-491e-4aef-b658-927c472985ea admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:45.276162 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1261/2518] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:45.280346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:45.291646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3dea-13ad-4965-b853-dd083865c4f2 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:45.296192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:45.297517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.297800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.298078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] PATH_INFO: `/v3/projects/3b1698ae9c7a47e79beda69ccee15afa/users/b31915d283a94937be1cf22b2780a8f2/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.300035 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1698ae9c7a47e79beda69ccee15afa, user_id=b31915d283a94937be1cf22b2780a8f2, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:45.302680 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:45.314073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1258/2519] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:45 2022] PUT /identity/v3/projects/3b1698ae9c7a47e79beda69ccee15afa/users/b31915d283a94937be1cf22b2780a8f2/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:45.324881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18a6f-ba58-4962-a83b-ff51dcc4a320 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.325389 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18a6f-ba58-4962-a83b-ff51dcc4a320 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.325611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18a6f-ba58-4962-a83b-ff51dcc4a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.356584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a3a18a6f-ba58-4962-a83b-ff51dcc4a320 None None] MFA Rules not processed for user `b31915d283a94937be1cf22b2780a8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:45.357762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a3a18a6f-ba58-4962-a83b-ff51dcc4a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:45.427260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1262/2520] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:45.439469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:45.441260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:45.502365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721e3cc-5a1a-4657-9d86-1f2830d12161 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:45.506019 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683221-0264-41ef-93ae-39e8250780eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:45.506649 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683221-0264-41ef-93ae-39e8250780eb service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.506930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683221-0264-41ef-93ae-39e8250780eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.507209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683221-0264-41ef-93ae-39e8250780eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.516934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683221-0264-41ef-93ae-39e8250780eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:45.518382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683221-0264-41ef-93ae-39e8250780eb service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:45.527842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1259/2521] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:45.573675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18a6f-ba58-4962-a83b-ff51dcc4a320 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:45.575058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a3a18a6f-ba58-4962-a83b-ff51dcc4a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:45.587726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18a6f-ba58-4962-a83b-ff51dcc4a320 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:45.591407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd6a0f-a1b8-4018-a57e-a4b49853bf08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:45.592045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd6a0f-a1b8-4018-a57e-a4b49853bf08 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:45.592320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd6a0f-a1b8-4018-a57e-a4b49853bf08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:45.592592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd6a0f-a1b8-4018-a57e-a4b49853bf08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:45.645988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:45.650125 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd6a0f-a1b8-4018-a57e-a4b49853bf08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:45.652194 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd6a0f-a1b8-4018-a57e-a4b49853bf08 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:45.662611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1263/2522] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:48.950560 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683221-0264-41ef-93ae-39e8250780eb service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:48.969370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:49.017045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683221-0264-41ef-93ae-39e8250780eb service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:49.021685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:49.022274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:49.022558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:49.022834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] PATH_INFO: `/v3/users/884488642e98409480879bf6ccfe98fc` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:49.024154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884488642e98409480879bf6ccfe98fc)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:49.026088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:49.072875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884488642e98409480879bf6ccfe98fc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.081176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884488642e98409480879bf6ccfe98fc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.081821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884488642e98409480879bf6ccfe98fc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.094325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884488642e98409480879bf6ccfe98fc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.094951 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884488642e98409480879bf6ccfe98fc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.107564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1260/2523] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:48 2022] DELETE /identity/v3/users/884488642e98409480879bf6ccfe98fc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:49.112142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff062c24-8ed8-4bd2-ba14-ba60dfa7f822 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:49.112627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff062c24-8ed8-4bd2-ba14-ba60dfa7f822 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:49.112726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff062c24-8ed8-4bd2-ba14-ba60dfa7f822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:49.135720 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ff062c24-8ed8-4bd2-ba14-ba60dfa7f822 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:49.136958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ff062c24-8ed8-4bd2-ba14-ba60dfa7f822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:49.196432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1264/2524] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:49.206562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:49.208007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:49.273382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178fb90-3e85-455c-8845-d2b6fab4ee50 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:49.276904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b9ec-9187-4d26-83c7-5d27efaa88d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:49.277520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b9ec-9187-4d26-83c7-5d27efaa88d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:49.277800 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b9ec-9187-4d26-83c7-5d27efaa88d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:49.278071 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b9ec-9187-4d26-83c7-5d27efaa88d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:49.287754 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77b9ec-9187-4d26-83c7-5d27efaa88d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:49.289182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77b9ec-9187-4d26-83c7-5d27efaa88d6 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:49.299277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1261/2525] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:49.592945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff062c24-8ed8-4bd2-ba14-ba60dfa7f822 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:49.595276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ff062c24-8ed8-4bd2-ba14-ba60dfa7f822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:49.610795 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff062c24-8ed8-4bd2-ba14-ba60dfa7f822 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:49.616351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:49.617010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:49.617345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:49.617616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] PATH_INFO: `/v3/projects/9f01c4a3b51243b4ac848e302e6d2277` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:49.619290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f01c4a3b51243b4ac848e302e6d2277)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:49.621252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:49.684513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f01c4a3b51243b4ac848e302e6d2277', 'request_id': 'req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.693323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f01c4a3b51243b4ac848e302e6d2277', 'request_id': 'req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.700281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f01c4a3b51243b4ac848e302e6d2277', 'request_id': 'req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.715623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] The token cache is being invalidate because project 9f01c4a3b51243b4ac848e302e6d2277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:49.716243 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.717026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.719268 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1265/2526] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:49 2022] DELETE /identity/v3/projects/9f01c4a3b51243b4ac848e302e6d2277 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:49.723787 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b9ec-9187-4d26-83c7-5d27efaa88d6 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:49.735229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b9ec-9187-4d26-83c7-5d27efaa88d6 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:49.785159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:49.822520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:49.823508 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:49.823936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:49.824349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] PATH_INFO: `/v3/users/b31915d283a94937be1cf22b2780a8f2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:49.826125 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31915d283a94937be1cf22b2780a8f2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:49.829948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:49.886955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31915d283a94937be1cf22b2780a8f2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.900024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31915d283a94937be1cf22b2780a8f2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.901509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31915d283a94937be1cf22b2780a8f2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.928149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31915d283a94937be1cf22b2780a8f2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.929296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-839ffc9a-edf9-48c2-bca2-32595bd28e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31915d283a94937be1cf22b2780a8f2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:49.946088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1262/2527] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:49 2022] DELETE /identity/v3/users/b31915d283a94937be1cf22b2780a8f2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:50.324200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:50.326130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:50.345415 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36163c8a-4166-44ee-bdd6-9e0dcd9abd57 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:50.414037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:50.414872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.415256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.415677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] PATH_INFO: `/v3/projects/3b1698ae9c7a47e79beda69ccee15afa` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:50.417060 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1698ae9c7a47e79beda69ccee15afa)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:50.419168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:50.442924 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:50.475580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1698ae9c7a47e79beda69ccee15afa', 'request_id': 'req-06fb5d16-0460-4e8c-b169-380d32d206ff'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:50.484942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1698ae9c7a47e79beda69ccee15afa', 'request_id': 'req-06fb5d16-0460-4e8c-b169-380d32d206ff'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:50.491472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1698ae9c7a47e79beda69ccee15afa', 'request_id': 'req-06fb5d16-0460-4e8c-b169-380d32d206ff'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:50.504072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] The token cache is being invalidate because project 3b1698ae9c7a47e79beda69ccee15afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:50.504421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:50.505149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06fb5d16-0460-4e8c-b169-380d32d206ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:50.506929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1266/2528] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:50 2022] DELETE /identity/v3/projects/3b1698ae9c7a47e79beda69ccee15afa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:50.513164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405755-03e6-4917-915a-2338edad41a9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.513712 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405755-03e6-4917-915a-2338edad41a9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.514067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405755-03e6-4917-915a-2338edad41a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:50.537372 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-19405755-03e6-4917-915a-2338edad41a9 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:50.538672 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-19405755-03e6-4917-915a-2338edad41a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:50.607690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1263/2529] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:50.620075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f007a2-05d1-41cc-bcd3-d6be166a85e8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.620577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f007a2-05d1-41cc-bcd3-d6be166a85e8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.621050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f007a2-05d1-41cc-bcd3-d6be166a85e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:50.650432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b5f007a2-05d1-41cc-bcd3-d6be166a85e8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:50.652273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b5f007a2-05d1-41cc-bcd3-d6be166a85e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:50.666199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1267/2530] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:50.673194 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19405755-03e6-4917-915a-2338edad41a9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:50.685183 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19405755-03e6-4917-915a-2338edad41a9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:50.691082 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:50.691764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.692048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.692325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:50.693030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:47:50.693339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:50.695055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:50.708390 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1264/2531] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:47:50.712975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f007a2-05d1-41cc-bcd3-d6be166a85e8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:50.723691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f007a2-05d1-41cc-bcd3-d6be166a85e8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:50.729236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4de57e-ff9a-4933-8b4f-5afe5591bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:50.729969 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4de57e-ff9a-4933-8b4f-5afe5591bcaf admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.730288 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4de57e-ff9a-4933-8b4f-5afe5591bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.730598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4de57e-ff9a-4933-8b4f-5afe5591bcaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:50.731313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4de57e-ff9a-4933-8b4f-5afe5591bcaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:50.733294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4de57e-ff9a-4933-8b4f-5afe5591bcaf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:50.768560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1268/2532] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:50 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:50.773080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:50.784927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5000-4034-4611-b01e-90938f1babdc admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:50.833005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:50.853207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ea651-b70a-4459-b26b-feacbdec939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:50.853843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea651-b70a-4459-b26b-feacbdec939d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.854126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea651-b70a-4459-b26b-feacbdec939d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.854407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea651-b70a-4459-b26b-feacbdec939d admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:50.855083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ea651-b70a-4459-b26b-feacbdec939d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:50.857114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ea651-b70a-4459-b26b-feacbdec939d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:50.887980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1265/2533] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:50 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:50.892218 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4de57e-ff9a-4933-8b4f-5afe5591bcaf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:50.903230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4de57e-ff9a-4933-8b4f-5afe5591bcaf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:50.909280 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa3cf-29a3-4c55-9dc9-9d15e23c048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:50.909916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa3cf-29a3-4c55-9dc9-9d15e23c048b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.910199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa3cf-29a3-4c55-9dc9-9d15e23c048b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.910475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa3cf-29a3-4c55-9dc9-9d15e23c048b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:50.911182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fa3cf-29a3-4c55-9dc9-9d15e23c048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:50.912984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fa3cf-29a3-4c55-9dc9-9d15e23c048b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:50.925150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1269/2534] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:50.931141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ea651-b70a-4459-b26b-feacbdec939d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:50.943075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ea651-b70a-4459-b26b-feacbdec939d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:50.950633 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cc107-324a-4fa5-8006-f376be51cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:50.951485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cc107-324a-4fa5-8006-f376be51cdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.951772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cc107-324a-4fa5-8006-f376be51cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.952050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cc107-324a-4fa5-8006-f376be51cdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:50.952758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cc107-324a-4fa5-8006-f376be51cdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:50.954389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cc107-324a-4fa5-8006-f376be51cdd2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:50.969557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1266/2535] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:50.974464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa3cf-29a3-4c55-9dc9-9d15e23c048b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:50.985796 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa3cf-29a3-4c55-9dc9-9d15e23c048b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:50.994164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e36b48-ce3a-411d-a73e-13bbe781e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:50.994926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e36b48-ce3a-411d-a73e-13bbe781e334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:50.995364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e36b48-ce3a-411d-a73e-13bbe781e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:50.995503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e36b48-ce3a-411d-a73e-13bbe781e334 admin admin] PATH_INFO: `/v3/projects/920630d35c794dbc97f20bf1ef5d01f1/users/a594b1057d1e434cbe1fe8dbe0921be4/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.012997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e36b48-ce3a-411d-a73e-13bbe781e334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920630d35c794dbc97f20bf1ef5d01f1, user_id=a594b1057d1e434cbe1fe8dbe0921be4, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:51.015815 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e36b48-ce3a-411d-a73e-13bbe781e334 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:51.032047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1270/2536] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:50 2022] PUT /identity/v3/projects/920630d35c794dbc97f20bf1ef5d01f1/users/a594b1057d1e434cbe1fe8dbe0921be4/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:51.042956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe515-fc63-42ca-997a-3fa24fc2accd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.043247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe515-fc63-42ca-997a-3fa24fc2accd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.043567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe515-fc63-42ca-997a-3fa24fc2accd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.074453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-892fe515-fc63-42ca-997a-3fa24fc2accd None None] MFA Rules not processed for user `a594b1057d1e434cbe1fe8dbe0921be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:51.075759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-892fe515-fc63-42ca-997a-3fa24fc2accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:51.152434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1267/2537] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:47:51.157916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e36b48-ce3a-411d-a73e-13bbe781e334 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:51.228301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e36b48-ce3a-411d-a73e-13bbe781e334 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:51.233567 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad038e-2b90-47a0-8b86-8dbeae0fb084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:51.234734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad038e-2b90-47a0-8b86-8dbeae0fb084 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.235015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad038e-2b90-47a0-8b86-8dbeae0fb084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.235392 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad038e-2b90-47a0-8b86-8dbeae0fb084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.236080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad038e-2b90-47a0-8b86-8dbeae0fb084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:51.238255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad038e-2b90-47a0-8b86-8dbeae0fb084 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:51.278466 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1271/2538] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:51 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:51.282798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe515-fc63-42ca-997a-3fa24fc2accd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:51.298462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe515-fc63-42ca-997a-3fa24fc2accd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:51.370231 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aa1bd-2665-4dd9-b082-2db36c5b6640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:51.370904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aa1bd-2665-4dd9-b082-2db36c5b6640 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.371179 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aa1bd-2665-4dd9-b082-2db36c5b6640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.371499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aa1bd-2665-4dd9-b082-2db36c5b6640 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.372202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7aa1bd-2665-4dd9-b082-2db36c5b6640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:51.374144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7aa1bd-2665-4dd9-b082-2db36c5b6640 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:51.405448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1268/2539] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:51 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:51.406576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad038e-2b90-47a0-8b86-8dbeae0fb084 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:51.417293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad038e-2b90-47a0-8b86-8dbeae0fb084 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:51.422637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4082c-9edd-4037-a375-ac1df1ca56e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:51.423302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4082c-9edd-4037-a375-ac1df1ca56e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.423617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4082c-9edd-4037-a375-ac1df1ca56e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.423892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4082c-9edd-4037-a375-ac1df1ca56e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.424595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4082c-9edd-4037-a375-ac1df1ca56e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:51.426249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4082c-9edd-4037-a375-ac1df1ca56e5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:51.441192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1272/2540] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:51.445114 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aa1bd-2665-4dd9-b082-2db36c5b6640 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:51.457289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aa1bd-2665-4dd9-b082-2db36c5b6640 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:51.462412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c478c-a6d1-4dcb-a4af-c296e081d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:51.463095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c478c-a6d1-4dcb-a4af-c296e081d2af admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.463433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c478c-a6d1-4dcb-a4af-c296e081d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.463705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c478c-a6d1-4dcb-a4af-c296e081d2af admin admin] PATH_INFO: `/v3/projects/5fa94035758447fdb53d005dc91aac8f/users/8619d2fcb603466f8435c2ef7c319177/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.480558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c478c-a6d1-4dcb-a4af-c296e081d2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa94035758447fdb53d005dc91aac8f, user_id=8619d2fcb603466f8435c2ef7c319177, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:51.483462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c478c-a6d1-4dcb-a4af-c296e081d2af admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:51.497839 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1269/2541] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:51 2022] PUT /identity/v3/projects/5fa94035758447fdb53d005dc91aac8f/users/8619d2fcb603466f8435c2ef7c319177/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:51.502995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4082c-9edd-4037-a375-ac1df1ca56e5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:51.514147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4082c-9edd-4037-a375-ac1df1ca56e5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:51.529941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:51.587439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4af9f-19e9-4d43-bfff-2e0b9c8d6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:51.588065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4af9f-19e9-4d43-bfff-2e0b9c8d6a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.588344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4af9f-19e9-4d43-bfff-2e0b9c8d6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.588615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4af9f-19e9-4d43-bfff-2e0b9c8d6a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.589308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4af9f-19e9-4d43-bfff-2e0b9c8d6a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:51.590927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4af9f-19e9-4d43-bfff-2e0b9c8d6a68 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:51.602017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1273/2542] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:51.606170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c478c-a6d1-4dcb-a4af-c296e081d2af admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:51.617585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c478c-a6d1-4dcb-a4af-c296e081d2af admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:51.622470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:51.623138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.623452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.623744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] PATH_INFO: `/v3/projects/5fa94035758447fdb53d005dc91aac8f/users/8619d2fcb603466f8435c2ef7c319177/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.625792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa94035758447fdb53d005dc91aac8f, user_id=8619d2fcb603466f8435c2ef7c319177, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:51.628543 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:51.639758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1270/2543] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:51 2022] PUT /identity/v3/projects/5fa94035758447fdb53d005dc91aac8f/users/8619d2fcb603466f8435c2ef7c319177/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:51.650603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fada-dd34-48ee-bd8e-5d1b12054797 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.650887 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fada-dd34-48ee-bd8e-5d1b12054797 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.651176 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fada-dd34-48ee-bd8e-5d1b12054797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.681710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ac77fada-dd34-48ee-bd8e-5d1b12054797 None None] MFA Rules not processed for user `8619d2fcb603466f8435c2ef7c319177`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:51.682835 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ac77fada-dd34-48ee-bd8e-5d1b12054797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:51.756514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1274/2544] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:51.768477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:51.770432 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:51.777479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:51.841784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37674ff0-fb90-42f5-abe4-1e2d3d6f30ba admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:51.845688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec93712-8a73-4bef-9f55-3c955f4ee80f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:51.846322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93712-8a73-4bef-9f55-3c955f4ee80f service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:51.846610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93712-8a73-4bef-9f55-3c955f4ee80f service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:51.846883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93712-8a73-4bef-9f55-3c955f4ee80f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:51.857512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec93712-8a73-4bef-9f55-3c955f4ee80f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:51.859659 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec93712-8a73-4bef-9f55-3c955f4ee80f service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:51.870550 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1271/2545] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:51.987396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fada-dd34-48ee-bd8e-5d1b12054797 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:52.000662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fada-dd34-48ee-bd8e-5d1b12054797 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:52.005249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229dcb0-8121-48ad-b3c7-740fbd0128ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:52.005927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229dcb0-8121-48ad-b3c7-740fbd0128ba service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:52.006314 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229dcb0-8121-48ad-b3c7-740fbd0128ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:52.006709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229dcb0-8121-48ad-b3c7-740fbd0128ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:52.078361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229dcb0-8121-48ad-b3c7-740fbd0128ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:52.079806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229dcb0-8121-48ad-b3c7-740fbd0128ba service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:52.089317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1275/2546] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:54.721832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec93712-8a73-4bef-9f55-3c955f4ee80f service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:54.785765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec93712-8a73-4bef-9f55-3c955f4ee80f service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:54.790341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:54.790973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:54.791281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:54.791585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] PATH_INFO: `/v3/users/a594b1057d1e434cbe1fe8dbe0921be4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:54.792744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a594b1057d1e434cbe1fe8dbe0921be4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:54.794675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:54.841559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a594b1057d1e434cbe1fe8dbe0921be4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:54.853000 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a594b1057d1e434cbe1fe8dbe0921be4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:54.853929 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a594b1057d1e434cbe1fe8dbe0921be4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:54.868295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a594b1057d1e434cbe1fe8dbe0921be4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:54.869014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a594b1057d1e434cbe1fe8dbe0921be4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:54.881830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1272/2547] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:54 2022] DELETE /identity/v3/users/a594b1057d1e434cbe1fe8dbe0921be4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:54.886532 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb8c7-3ccd-49fa-9909-fc68d0dae19b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:54.886972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb8c7-3ccd-49fa-9909-fc68d0dae19b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:54.887232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb8c7-3ccd-49fa-9909-fc68d0dae19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:54.908870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e83bb8c7-3ccd-49fa-9909-fc68d0dae19b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:54.910192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e83bb8c7-3ccd-49fa-9909-fc68d0dae19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:54.945198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:54.975687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1276/2548] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:54.985272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:54.986710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:55.026833 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:55.056567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8670a1e-994d-45c9-a1c1-d0aa82d83018 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:55.060230 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94b98-efb2-4d05-8320-c8682ca0982d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:55.060856 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94b98-efb2-4d05-8320-c8682ca0982d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:55.061171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94b98-efb2-4d05-8320-c8682ca0982d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:55.061449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94b98-efb2-4d05-8320-c8682ca0982d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:55.071138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c94b98-efb2-4d05-8320-c8682ca0982d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:55.072710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c94b98-efb2-4d05-8320-c8682ca0982d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:55.082734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1273/2549] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:55.358606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bb8c7-3ccd-49fa-9909-fc68d0dae19b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:55.360684 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e83bb8c7-3ccd-49fa-9909-fc68d0dae19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:55.373611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bb8c7-3ccd-49fa-9909-fc68d0dae19b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:55.379870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:55.380688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:55.380966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:55.381337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] PATH_INFO: `/v3/projects/920630d35c794dbc97f20bf1ef5d01f1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:55.382699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=920630d35c794dbc97f20bf1ef5d01f1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:55.384701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:55.446706 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920630d35c794dbc97f20bf1ef5d01f1', 'request_id': 'req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.454271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920630d35c794dbc97f20bf1ef5d01f1', 'request_id': 'req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.460163 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920630d35c794dbc97f20bf1ef5d01f1', 'request_id': 'req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.471226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] The token cache is being invalidate because project 920630d35c794dbc97f20bf1ef5d01f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:55.471475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.472109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.473619 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1277/2550] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:55 2022] DELETE /identity/v3/projects/920630d35c794dbc97f20bf1ef5d01f1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:55.477829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94b98-efb2-4d05-8320-c8682ca0982d service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:55.488380 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94b98-efb2-4d05-8320-c8682ca0982d service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:55.550564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:55.551227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:55.551549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:55.551828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] PATH_INFO: `/v3/users/8619d2fcb603466f8435c2ef7c319177` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:55.553165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8619d2fcb603466f8435c2ef7c319177)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:55.555100 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:55.603261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8619d2fcb603466f8435c2ef7c319177'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.611359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8619d2fcb603466f8435c2ef7c319177'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.612104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8619d2fcb603466f8435c2ef7c319177'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.625205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8619d2fcb603466f8435c2ef7c319177'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.625843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eda0e8b7-23cc-4d44-b5fb-3d4766da3090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8619d2fcb603466f8435c2ef7c319177'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:55.638510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1274/2551] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:47:55 2022] DELETE /identity/v3/users/8619d2fcb603466f8435c2ef7c319177 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:55.939972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:55.941514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:55.962613 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60234f-6c02-4176-b8dd-f1ef3b1e1c4a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:56.156966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:56.157624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.157916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.158201 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] PATH_INFO: `/v3/projects/5fa94035758447fdb53d005dc91aac8f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.159391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa94035758447fdb53d005dc91aac8f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:56.161395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:56.217443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa94035758447fdb53d005dc91aac8f', 'request_id': 'req-b762bc80-fa8e-4164-baeb-3f9e117ade0f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:56.226422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa94035758447fdb53d005dc91aac8f', 'request_id': 'req-b762bc80-fa8e-4164-baeb-3f9e117ade0f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:56.233530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:56.233530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa94035758447fdb53d005dc91aac8f', 'request_id': 'req-b762bc80-fa8e-4164-baeb-3f9e117ade0f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:56.255262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] The token cache is being invalidate because project 5fa94035758447fdb53d005dc91aac8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:56.255826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:56.256895 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b762bc80-fa8e-4164-baeb-3f9e117ade0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:56.260932 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1278/2552] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:47:55 2022] DELETE /identity/v3/projects/5fa94035758447fdb53d005dc91aac8f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:56.265934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42dbf-aa95-4c61-91a1-7675ccc4014a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.266734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42dbf-aa95-4c61-91a1-7675ccc4014a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.266734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42dbf-aa95-4c61-91a1-7675ccc4014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.293366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-71a42dbf-aa95-4c61-91a1-7675ccc4014a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:56.294594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-71a42dbf-aa95-4c61-91a1-7675ccc4014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:56.346043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:56.364392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1275/2553] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:47:56.431355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fd7a0-dad7-4fc3-b92f-8c657f390ed2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.431676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fd7a0-dad7-4fc3-b92f-8c657f390ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.431948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fd7a0-dad7-4fc3-b92f-8c657f390ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.451346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bc9fd7a0-dad7-4fc3-b92f-8c657f390ed2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:56.453175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bc9fd7a0-dad7-4fc3-b92f-8c657f390ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:56.461027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1279/2554] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:56.465403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42dbf-aa95-4c61-91a1-7675ccc4014a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:56.478643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42dbf-aa95-4c61-91a1-7675ccc4014a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:56.484495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:56.484849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.485130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.485447 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.486206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:47:56.486510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:56.488178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:56.501371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1276/2555] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:47:56.505907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fd7a0-dad7-4fc3-b92f-8c657f390ed2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:56.515103 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fd7a0-dad7-4fc3-b92f-8c657f390ed2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:56.519858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189533-204f-4e12-90eb-1cf8becab81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:56.520534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189533-204f-4e12-90eb-1cf8becab81c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.520810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189533-204f-4e12-90eb-1cf8becab81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.521075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189533-204f-4e12-90eb-1cf8becab81c admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.521743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58189533-204f-4e12-90eb-1cf8becab81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:56.523831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58189533-204f-4e12-90eb-1cf8becab81c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:56.552441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1280/2556] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:56 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:56.557113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:56.568174 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f25cae-28d9-4002-a7fe-a03ea9d1954a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:56.628208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1be3-2814-443d-8b43-5e0d15c26e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:56.628745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1be3-2814-443d-8b43-5e0d15c26e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.629028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1be3-2814-443d-8b43-5e0d15c26e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.629305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1be3-2814-443d-8b43-5e0d15c26e53 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.629978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e1be3-2814-443d-8b43-5e0d15c26e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:56.631949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e1be3-2814-443d-8b43-5e0d15c26e53 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:56.653816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1277/2557] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:56 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:56.658377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189533-204f-4e12-90eb-1cf8becab81c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:56.670334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189533-204f-4e12-90eb-1cf8becab81c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:56.675668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bdbd3-23d3-4079-90b0-6e18633e36ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:56.676303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bdbd3-23d3-4079-90b0-6e18633e36ca admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.676585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bdbd3-23d3-4079-90b0-6e18633e36ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.676860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bdbd3-23d3-4079-90b0-6e18633e36ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.677603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bdbd3-23d3-4079-90b0-6e18633e36ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:56.679212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bdbd3-23d3-4079-90b0-6e18633e36ca admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:56.690825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1281/2558] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:56.695391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1be3-2814-443d-8b43-5e0d15c26e53 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:56.706454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1be3-2814-443d-8b43-5e0d15c26e53 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:56.712107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75acf9-f57a-4f11-9dd3-85995f7784e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:56.713189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75acf9-f57a-4f11-9dd3-85995f7784e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.713792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75acf9-f57a-4f11-9dd3-85995f7784e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.714324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75acf9-f57a-4f11-9dd3-85995f7784e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.715742 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75acf9-f57a-4f11-9dd3-85995f7784e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:56.719081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75acf9-f57a-4f11-9dd3-85995f7784e5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:56.738363 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1278/2559] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:56.743298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bdbd3-23d3-4079-90b0-6e18633e36ca admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:56.762810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bdbd3-23d3-4079-90b0-6e18633e36ca admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:56.767399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949592e0-4bb6-497e-99c7-3b1efbc42d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:56.768221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949592e0-4bb6-497e-99c7-3b1efbc42d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.769330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949592e0-4bb6-497e-99c7-3b1efbc42d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.769587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949592e0-4bb6-497e-99c7-3b1efbc42d1c admin admin] PATH_INFO: `/v3/projects/2cee36d88cf3426ba866f46e2ff8e5a2/users/c1802ad93b3c405bb6fff06fc8db9f90/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.786301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949592e0-4bb6-497e-99c7-3b1efbc42d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cee36d88cf3426ba866f46e2ff8e5a2, user_id=c1802ad93b3c405bb6fff06fc8db9f90, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:56.788983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949592e0-4bb6-497e-99c7-3b1efbc42d1c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:56.807383 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1282/2560] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:56 2022] PUT /identity/v3/projects/2cee36d88cf3426ba866f46e2ff8e5a2/users/c1802ad93b3c405bb6fff06fc8db9f90/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:56.818199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2899c-e728-41ef-8ad9-4baebbf8640f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:56.818471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2899c-e728-41ef-8ad9-4baebbf8640f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:56.818853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2899c-e728-41ef-8ad9-4baebbf8640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:56.849631 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-22c2899c-e728-41ef-8ad9-4baebbf8640f None None] MFA Rules not processed for user `c1802ad93b3c405bb6fff06fc8db9f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:56.850998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-22c2899c-e728-41ef-8ad9-4baebbf8640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:56.928405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1279/2561] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:56.933114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949592e0-4bb6-497e-99c7-3b1efbc42d1c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:57.009799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949592e0-4bb6-497e-99c7-3b1efbc42d1c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:57.016035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d16e5-62c9-4321-8d97-db49d79bbbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:57.016852 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d16e5-62c9-4321-8d97-db49d79bbbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:57.017226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d16e5-62c9-4321-8d97-db49d79bbbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:57.017668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d16e5-62c9-4321-8d97-db49d79bbbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:57.018616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d16e5-62c9-4321-8d97-db49d79bbbe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:57.020769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d16e5-62c9-4321-8d97-db49d79bbbe5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:57.057778 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1283/2562] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:47:56 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:57.062322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2899c-e728-41ef-8ad9-4baebbf8640f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:57.074785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2899c-e728-41ef-8ad9-4baebbf8640f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:57.126247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:57.145391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5f20-2ab8-4ad6-a2c6-07a75706776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:57.146215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5f20-2ab8-4ad6-a2c6-07a75706776e admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:57.146433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5f20-2ab8-4ad6-a2c6-07a75706776e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:57.146741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5f20-2ab8-4ad6-a2c6-07a75706776e admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:57.147446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5f20-2ab8-4ad6-a2c6-07a75706776e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:57.149515 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5f20-2ab8-4ad6-a2c6-07a75706776e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:57.172421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1280/2563] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:47:57 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:57.177089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d16e5-62c9-4321-8d97-db49d79bbbe5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:57.188456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d16e5-62c9-4321-8d97-db49d79bbbe5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:57.196136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99278-d1cc-40e7-b13a-686f71e2fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:57.197090 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99278-d1cc-40e7-b13a-686f71e2fbcf admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:57.197576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99278-d1cc-40e7-b13a-686f71e2fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:57.198035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99278-d1cc-40e7-b13a-686f71e2fbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:57.199029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f99278-d1cc-40e7-b13a-686f71e2fbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:57.200812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f99278-d1cc-40e7-b13a-686f71e2fbcf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:57.212919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1284/2564] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:57.218044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5f20-2ab8-4ad6-a2c6-07a75706776e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:57.230121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5f20-2ab8-4ad6-a2c6-07a75706776e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:57.235612 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92c12f-4a96-48ff-bcb7-a1cf4d29b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:57.236309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92c12f-4a96-48ff-bcb7-a1cf4d29b8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:57.236599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92c12f-4a96-48ff-bcb7-a1cf4d29b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:57.236878 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92c12f-4a96-48ff-bcb7-a1cf4d29b8e3 admin admin] PATH_INFO: `/v3/projects/707ed36bdff543f49cf97d4d1c44b9f0/users/f3788583af2b402cb8bb6a4df3c7f841/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:57.416562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92c12f-4a96-48ff-bcb7-a1cf4d29b8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707ed36bdff543f49cf97d4d1c44b9f0, user_id=f3788583af2b402cb8bb6a4df3c7f841, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:57.419258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92c12f-4a96-48ff-bcb7-a1cf4d29b8e3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:57.434492 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1281/2565] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:57 2022] PUT /identity/v3/projects/707ed36bdff543f49cf97d4d1c44b9f0/users/f3788583af2b402cb8bb6a4df3c7f841/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:57.438890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99278-d1cc-40e7-b13a-686f71e2fbcf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:57.450142 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99278-d1cc-40e7-b13a-686f71e2fbcf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:57.515106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f857200-eed8-4640-be99-75540173ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:57.516538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857200-eed8-4640-be99-75540173ca33 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:57.516926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857200-eed8-4640-be99-75540173ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:57.517314 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857200-eed8-4640-be99-75540173ca33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:57.518364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f857200-eed8-4640-be99-75540173ca33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:57.521116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f857200-eed8-4640-be99-75540173ca33 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:57.524743 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:57.536038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1285/2566] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:57.540090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92c12f-4a96-48ff-bcb7-a1cf4d29b8e3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:57.551519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92c12f-4a96-48ff-bcb7-a1cf4d29b8e3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:57.557384 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:57.558068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:57.558346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:57.558620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] PATH_INFO: `/v3/projects/707ed36bdff543f49cf97d4d1c44b9f0/users/f3788583af2b402cb8bb6a4df3c7f841/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:57.560643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=707ed36bdff543f49cf97d4d1c44b9f0, user_id=f3788583af2b402cb8bb6a4df3c7f841, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:57.564261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:57.576268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1282/2567] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:47:57 2022] PUT /identity/v3/projects/707ed36bdff543f49cf97d4d1c44b9f0/users/f3788583af2b402cb8bb6a4df3c7f841/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:57.588714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442ebdc-4659-4d0f-847c-7cec9e6ec9f7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:57.589079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442ebdc-4659-4d0f-847c-7cec9e6ec9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:57.589400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442ebdc-4659-4d0f-847c-7cec9e6ec9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:57.621857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1442ebdc-4659-4d0f-847c-7cec9e6ec9f7 None None] MFA Rules not processed for user `f3788583af2b402cb8bb6a4df3c7f841`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:57.623128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1442ebdc-4659-4d0f-847c-7cec9e6ec9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:57.703976 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1286/2568] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:47:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:57.717161 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:57.719278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:57.783582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a260-818f-424d-8c51-fbe4400b66ca admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:57.787917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9e7ac-d28b-42fa-8e29-071b835b6695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:57.788605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9e7ac-d28b-42fa-8e29-071b835b6695 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:57.788925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9e7ac-d28b-42fa-8e29-071b835b6695 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:57.789203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9e7ac-d28b-42fa-8e29-071b835b6695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:57.869132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9e7ac-d28b-42fa-8e29-071b835b6695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:57.870520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9e7ac-d28b-42fa-8e29-071b835b6695 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:57.880872 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1283/2569] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:47:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:00.501078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442ebdc-4659-4d0f-847c-7cec9e6ec9f7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:00.568094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442ebdc-4659-4d0f-847c-7cec9e6ec9f7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:00.572672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:00.573318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:00.573598 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:00.573872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] PATH_INFO: `/v3/users/c1802ad93b3c405bb6fff06fc8db9f90` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:00.575051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1802ad93b3c405bb6fff06fc8db9f90)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:00.577016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:00.630160 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1802ad93b3c405bb6fff06fc8db9f90'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:00.637836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1802ad93b3c405bb6fff06fc8db9f90'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:00.645478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1802ad93b3c405bb6fff06fc8db9f90'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:00.646270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1802ad93b3c405bb6fff06fc8db9f90'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:00.658995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1802ad93b3c405bb6fff06fc8db9f90'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:00.673073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1287/2570] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:00 2022] DELETE /identity/v3/users/c1802ad93b3c405bb6fff06fc8db9f90 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:00.678052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349dcc-f98a-46f3-95ab-b8e1a36c4af2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:00.678629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349dcc-f98a-46f3-95ab-b8e1a36c4af2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:00.678884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349dcc-f98a-46f3-95ab-b8e1a36c4af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:00.698909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d2349dcc-f98a-46f3-95ab-b8e1a36c4af2 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:00.700202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d2349dcc-f98a-46f3-95ab-b8e1a36c4af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:00.761187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:00.781830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1284/2571] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:00.792217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:00.793658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:00.800497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:00.865469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bb634-17d3-41f6-b2fe-e6b3591efea0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:00.869177 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876efe-9568-4a0a-814c-00f24486a1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:00.869798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876efe-9568-4a0a-814c-00f24486a1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:00.870075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876efe-9568-4a0a-814c-00f24486a1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:00.870349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876efe-9568-4a0a-814c-00f24486a1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:00.881260 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39876efe-9568-4a0a-814c-00f24486a1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:00.882824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39876efe-9568-4a0a-814c-00f24486a1c9 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:00.898589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1288/2572] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:01.214139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2349dcc-f98a-46f3-95ab-b8e1a36c4af2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:01.215904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d2349dcc-f98a-46f3-95ab-b8e1a36c4af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:01.234040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2349dcc-f98a-46f3-95ab-b8e1a36c4af2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:01.239483 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:01.240168 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:01.242377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:01.242802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] PATH_INFO: `/v3/projects/2cee36d88cf3426ba866f46e2ff8e5a2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:01.244293 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cee36d88cf3426ba866f46e2ff8e5a2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:01.246449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:01.310176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cee36d88cf3426ba866f46e2ff8e5a2', 'request_id': 'req-eae03f4b-bea0-40f4-80e8-8da20e32f141'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.316812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cee36d88cf3426ba866f46e2ff8e5a2', 'request_id': 'req-eae03f4b-bea0-40f4-80e8-8da20e32f141'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.323284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cee36d88cf3426ba866f46e2ff8e5a2', 'request_id': 'req-eae03f4b-bea0-40f4-80e8-8da20e32f141'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.341391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] The token cache is being invalidate because project 2cee36d88cf3426ba866f46e2ff8e5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:01.341893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.342859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.345853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1285/2573] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:01 2022] DELETE /identity/v3/projects/2cee36d88cf3426ba866f46e2ff8e5a2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:01.350403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876efe-9568-4a0a-814c-00f24486a1c9 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:01.361280 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876efe-9568-4a0a-814c-00f24486a1c9 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:01.423650 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:01.423650 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:01.423972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:01.424255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] PATH_INFO: `/v3/users/f3788583af2b402cb8bb6a4df3c7f841` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:01.425400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3788583af2b402cb8bb6a4df3c7f841)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:01.427321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:01.497425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3788583af2b402cb8bb6a4df3c7f841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.509175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3788583af2b402cb8bb6a4df3c7f841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.518051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3788583af2b402cb8bb6a4df3c7f841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.518779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3788583af2b402cb8bb6a4df3c7f841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.541763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbe84275-71c0-4419-9b59-816dec7e307b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3788583af2b402cb8bb6a4df3c7f841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:01.549565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1289/2574] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:01 2022] DELETE /identity/v3/users/f3788583af2b402cb8bb6a4df3c7f841 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:01.870950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:01.872766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:01.886120 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae03f4b-bea0-40f4-80e8-8da20e32f141 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:01.978034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:01.978699 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:01.978981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:01.979255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] PATH_INFO: `/v3/projects/707ed36bdff543f49cf97d4d1c44b9f0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:01.980553 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707ed36bdff543f49cf97d4d1c44b9f0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:01.982477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:02.041892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707ed36bdff543f49cf97d4d1c44b9f0', 'request_id': 'req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:02.049108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707ed36bdff543f49cf97d4d1c44b9f0', 'request_id': 'req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:02.056514 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707ed36bdff543f49cf97d4d1c44b9f0', 'request_id': 'req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:02.071354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] The token cache is being invalidate because project 707ed36bdff543f49cf97d4d1c44b9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:02.071678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:02.072337 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-65c1bcfa-c6e4-4c8c-b52c-f8d31ad1cd93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:02.074041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1286/2575] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:01 2022] DELETE /identity/v3/projects/707ed36bdff543f49cf97d4d1c44b9f0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:02.079725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed39a-6c33-4515-bb8a-5a35a142d16d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.080011 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed39a-6c33-4515-bb8a-5a35a142d16d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.080290 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed39a-6c33-4515-bb8a-5a35a142d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.101648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-764ed39a-6c33-4515-bb8a-5a35a142d16d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:02.102937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-764ed39a-6c33-4515-bb8a-5a35a142d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:02.123098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:02.174654 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1290/2576] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:02.184119 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517762ce-87b5-44f2-b726-74c42d3e1010 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.184628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517762ce-87b5-44f2-b726-74c42d3e1010 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.185074 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517762ce-87b5-44f2-b726-74c42d3e1010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.195316 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:02.208439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-517762ce-87b5-44f2-b726-74c42d3e1010 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:02.210292 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-517762ce-87b5-44f2-b726-74c42d3e1010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:02.218731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1287/2577] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:02.223076 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ed39a-6c33-4515-bb8a-5a35a142d16d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:02.234672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ed39a-6c33-4515-bb8a-5a35a142d16d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:02.243890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:02.244911 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.245382 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.246065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.248064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:02.248614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:02.251275 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:02.269431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1291/2578] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:48:02.274227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517762ce-87b5-44f2-b726-74c42d3e1010 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:02.284247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517762ce-87b5-44f2-b726-74c42d3e1010 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:02.289703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f1ee-0758-41ab-8de0-d265fe81af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:02.290340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f1ee-0758-41ab-8de0-d265fe81af08 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.290624 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f1ee-0758-41ab-8de0-d265fe81af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.290901 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f1ee-0758-41ab-8de0-d265fe81af08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.291618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249f1ee-0758-41ab-8de0-d265fe81af08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:02.293569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249f1ee-0758-41ab-8de0-d265fe81af08 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:02.328772 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1288/2579] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:02 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:02.334154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:02.349423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499ec1-38e5-4c83-be9f-0500c4327a3a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:02.428297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06028fc7-ddc2-4439-aa85-233c5e3ed643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:02.428817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028fc7-ddc2-4439-aa85-233c5e3ed643 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.429110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028fc7-ddc2-4439-aa85-233c5e3ed643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.429390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028fc7-ddc2-4439-aa85-233c5e3ed643 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.430066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06028fc7-ddc2-4439-aa85-233c5e3ed643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:02.432361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06028fc7-ddc2-4439-aa85-233c5e3ed643 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:02.458281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1292/2580] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:02 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:02.463060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f1ee-0758-41ab-8de0-d265fe81af08 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:02.473832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f1ee-0758-41ab-8de0-d265fe81af08 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:02.479454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a38e3-6b4b-4d2b-ad0a-0258e0e5f900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:02.480093 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a38e3-6b4b-4d2b-ad0a-0258e0e5f900 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.480370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a38e3-6b4b-4d2b-ad0a-0258e0e5f900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.480644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a38e3-6b4b-4d2b-ad0a-0258e0e5f900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.481346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a38e3-6b4b-4d2b-ad0a-0258e0e5f900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:02.482965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a38e3-6b4b-4d2b-ad0a-0258e0e5f900 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:02.494806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1289/2581] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:02.498964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06028fc7-ddc2-4439-aa85-233c5e3ed643 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:02.511903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06028fc7-ddc2-4439-aa85-233c5e3ed643 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:02.516948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a2e52-2fa3-4d46-a5cc-ebef4b8081f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:02.517694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a2e52-2fa3-4d46-a5cc-ebef4b8081f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.517985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a2e52-2fa3-4d46-a5cc-ebef4b8081f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.518266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a2e52-2fa3-4d46-a5cc-ebef4b8081f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.518984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a2e52-2fa3-4d46-a5cc-ebef4b8081f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:02.520716 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a2e52-2fa3-4d46-a5cc-ebef4b8081f6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:02.536632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1293/2582] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:02.541962 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a38e3-6b4b-4d2b-ad0a-0258e0e5f900 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:02.558485 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a38e3-6b4b-4d2b-ad0a-0258e0e5f900 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:02.564044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:02.564727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.565007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.565289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] PATH_INFO: `/v3/projects/06c8d2afe83143bea610116fda05cc2d/users/86d95cc1a98647fbbb9ef59a4f397d08/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.582245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c8d2afe83143bea610116fda05cc2d, user_id=86d95cc1a98647fbbb9ef59a4f397d08, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:02.585117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:02.600001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1290/2583] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:02 2022] PUT /identity/v3/projects/06c8d2afe83143bea610116fda05cc2d/users/86d95cc1a98647fbbb9ef59a4f397d08/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:02.610930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4018b6-39c4-46b1-a353-60469fb1af2d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.611221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4018b6-39c4-46b1-a353-60469fb1af2d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.611537 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4018b6-39c4-46b1-a353-60469fb1af2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.642583 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3e4018b6-39c4-46b1-a353-60469fb1af2d None None] MFA Rules not processed for user `86d95cc1a98647fbbb9ef59a4f397d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:02.643900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3e4018b6-39c4-46b1-a353-60469fb1af2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:02.715542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1294/2584] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:02.728814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:02.730639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:02.811452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682c13-0284-434d-96f2-d290fb9a5067 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:02.815765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9482a3e-c97e-484a-bfa6-f584c36d6e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:02.816394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9482a3e-c97e-484a-bfa6-f584c36d6e51 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:02.816667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9482a3e-c97e-484a-bfa6-f584c36d6e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:02.816945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9482a3e-c97e-484a-bfa6-f584c36d6e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:02.826331 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9482a3e-c97e-484a-bfa6-f584c36d6e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:02.828375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9482a3e-c97e-484a-bfa6-f584c36d6e51 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:02.838663 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1291/2585] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:48:07.966016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4018b6-39c4-46b1-a353-60469fb1af2d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:07.990144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:08.048623 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4018b6-39c4-46b1-a353-60469fb1af2d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:08.058230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:08.059326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:08.059575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:08.059857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] PATH_INFO: `/v3/users/86d95cc1a98647fbbb9ef59a4f397d08` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:08.061069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d95cc1a98647fbbb9ef59a4f397d08)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:08.063180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:08.122495 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d95cc1a98647fbbb9ef59a4f397d08'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.130524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d95cc1a98647fbbb9ef59a4f397d08'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.139010 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d95cc1a98647fbbb9ef59a4f397d08'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.139881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d95cc1a98647fbbb9ef59a4f397d08'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.156345 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d95cc1a98647fbbb9ef59a4f397d08'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.172789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1295/2586] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:07 2022] DELETE /identity/v3/users/86d95cc1a98647fbbb9ef59a4f397d08 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:08.179056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e570e-e7c6-4ee5-91c4-143169597a9a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:08.179685 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e570e-e7c6-4ee5-91c4-143169597a9a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:08.180207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e570e-e7c6-4ee5-91c4-143169597a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:08.203177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-748e570e-e7c6-4ee5-91c4-143169597a9a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:08.204466 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-748e570e-e7c6-4ee5-91c4-143169597a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:08.310758 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1292/2587] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:08.321245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:08.322672 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:08.398496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403335ec-579b-4ece-b4ac-d6367dc2fb23 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:08.402202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:08.402826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:08.403110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:08.403410 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:08.414224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:08.415702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:08.425442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1296/2588] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:08.745356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e570e-e7c6-4ee5-91c4-143169597a9a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:08.746830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-748e570e-e7c6-4ee5-91c4-143169597a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:08.760957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e570e-e7c6-4ee5-91c4-143169597a9a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:08.767546 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:08.768329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:08.768661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:08.768945 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] PATH_INFO: `/v3/projects/06c8d2afe83143bea610116fda05cc2d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:08.770223 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c8d2afe83143bea610116fda05cc2d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:08.772714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:08.822353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:08.833544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c8d2afe83143bea610116fda05cc2d', 'request_id': 'req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.841789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c8d2afe83143bea610116fda05cc2d', 'request_id': 'req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.848805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c8d2afe83143bea610116fda05cc2d', 'request_id': 'req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.862861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] The token cache is being invalidate because project 06c8d2afe83143bea610116fda05cc2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:08.863153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.863965 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:08.865767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1293/2589] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:08 2022] DELETE /identity/v3/projects/06c8d2afe83143bea610116fda05cc2d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:18.421110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=70,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:18.859452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:22.760947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:22.762546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:22.774132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd47d77-cae1-4ec8-a702-c969802e4538 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:22.824605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:22.825219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:22.825496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:22.825770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:22.827569 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:22.912700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:22.914303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:22.931605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1297/2590] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:26.384479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:26.385987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:26.407024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf340c9-ae9a-4107-8d5c-93dcda9b4e80 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:26.412820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:26.413557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:26.413834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:26.414108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] PATH_INFO: `/v3/users/b325a118b0964730ada2630cd2b47fb4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:26.428667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b325a118b0964730ada2630cd2b47fb4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:26.430573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:26.481403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b325a118b0964730ada2630cd2b47fb4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.488992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b325a118b0964730ada2630cd2b47fb4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.489819 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b325a118b0964730ada2630cd2b47fb4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.502903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b325a118b0964730ada2630cd2b47fb4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.503596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b325a118b0964730ada2630cd2b47fb4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.516571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1294/2591] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:26 2022] DELETE /identity/v3/users/b325a118b0964730ada2630cd2b47fb4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:26.703446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:26.718251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3f70-e5cf-40b2-bcff-e93c0ad35faa service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:26.784381 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:26.785153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:26.786455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:26.786455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] PATH_INFO: `/v3/projects/dd50ab9197794a99be717b51f8778b68` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:26.797872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd50ab9197794a99be717b51f8778b68)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:26.799812 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:26.820022 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:26.821396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:26.850175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:26.854472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd50ab9197794a99be717b51f8778b68', 'request_id': 'req-dbe60066-48bd-46e1-b913-ce02ab6078df'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.864032 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd50ab9197794a99be717b51f8778b68', 'request_id': 'req-dbe60066-48bd-46e1-b913-ce02ab6078df'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.870021 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd50ab9197794a99be717b51f8778b68', 'request_id': 'req-dbe60066-48bd-46e1-b913-ce02ab6078df'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.881928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] The token cache is being invalidate because project dd50ab9197794a99be717b51f8778b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:26.882208 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.882870 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dbe60066-48bd-46e1-b913-ce02ab6078df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:26.882980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a0be4-fdbb-412c-9ead-de2a7a836de2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:26.884404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1298/2592] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:26 2022] DELETE /identity/v3/projects/dd50ab9197794a99be717b51f8778b68 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:26.889083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd19d4-1974-480d-a1b9-a3a51eb2ff0b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:26.889415 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd19d4-1974-480d-a1b9-a3a51eb2ff0b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:26.889699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd19d4-1974-480d-a1b9-a3a51eb2ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:26.911239 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-66cd19d4-1974-480d-a1b9-a3a51eb2ff0b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:26.912018 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-66cd19d4-1974-480d-a1b9-a3a51eb2ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:26.940528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:26.941713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:26.942030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:26.942494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:26.945582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:26.987724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:27.006489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1299/2593] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:27.009077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d28e-f933-4d32-a04c-b4f4bb11a928 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.009077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d28e-f933-4d32-a04c-b4f4bb11a928 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.009362 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d28e-f933-4d32-a04c-b4f4bb11a928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.029104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3d75d28e-f933-4d32-a04c-b4f4bb11a928 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:27.030901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3d75d28e-f933-4d32-a04c-b4f4bb11a928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:27.031297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:27.033049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:27.042962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1300/2594] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:27.043894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75d28e-f933-4d32-a04c-b4f4bb11a928 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:27.044569 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1295/2595] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:48:27.059390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75d28e-f933-4d32-a04c-b4f4bb11a928 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:27.064469 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:27.065096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.065381 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.065658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.066364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:27.066673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:27.068388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:27.082460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1301/2596] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:48:27.086921 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:27.097138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc35edc-975f-49df-85a3-da004df4e36e service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:27.101792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99119b-33c0-4945-89e6-0b98a8084d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:27.102417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99119b-33c0-4945-89e6-0b98a8084d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.102703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99119b-33c0-4945-89e6-0b98a8084d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.102978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99119b-33c0-4945-89e6-0b98a8084d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.103695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99119b-33c0-4945-89e6-0b98a8084d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:27.105655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99119b-33c0-4945-89e6-0b98a8084d7d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:27.137615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1296/2597] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:27 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:27.138760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:27.149734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717de51-0097-47c7-af1c-8401968fa759 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:27.209421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790054d4-f9ef-4edc-8af1-624a0512172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:27.210159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790054d4-f9ef-4edc-8af1-624a0512172f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.210510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790054d4-f9ef-4edc-8af1-624a0512172f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.210794 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790054d4-f9ef-4edc-8af1-624a0512172f admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.211483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790054d4-f9ef-4edc-8af1-624a0512172f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:27.214419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790054d4-f9ef-4edc-8af1-624a0512172f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:27.245877 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1302/2598] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:27 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:27.247173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99119b-33c0-4945-89e6-0b98a8084d7d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:27.257936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99119b-33c0-4945-89e6-0b98a8084d7d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:27.262601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499f29e-28ad-4465-a2df-e1d35990221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:27.263224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499f29e-28ad-4465-a2df-e1d35990221b admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.263554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499f29e-28ad-4465-a2df-e1d35990221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.263830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499f29e-28ad-4465-a2df-e1d35990221b admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.265138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499f29e-28ad-4465-a2df-e1d35990221b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:27.266740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499f29e-28ad-4465-a2df-e1d35990221b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:27.277377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1297/2599] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:48:27.282514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790054d4-f9ef-4edc-8af1-624a0512172f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:27.293605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790054d4-f9ef-4edc-8af1-624a0512172f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:27.298570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7ff66-7c16-4299-b17d-9112ffa14b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:27.299192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7ff66-7c16-4299-b17d-9112ffa14b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.299589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7ff66-7c16-4299-b17d-9112ffa14b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.299869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7ff66-7c16-4299-b17d-9112ffa14b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.300562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7ff66-7c16-4299-b17d-9112ffa14b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:27.302339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7ff66-7c16-4299-b17d-9112ffa14b31 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:27.314157 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1303/2600] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:27.318391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499f29e-28ad-4465-a2df-e1d35990221b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:27.329203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499f29e-28ad-4465-a2df-e1d35990221b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:27.334269 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:27.334950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.335232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.335555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] PATH_INFO: `/v3/projects/aad0801c5e4442f8a0ec3ee13c6009e0/users/620b8e6ce8b34987be887614c698b182/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.352395 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad0801c5e4442f8a0ec3ee13c6009e0, user_id=620b8e6ce8b34987be887614c698b182, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:27.355049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:27.369989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1298/2601] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:27 2022] PUT /identity/v3/projects/aad0801c5e4442f8a0ec3ee13c6009e0/users/620b8e6ce8b34987be887614c698b182/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:27.380366 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922b1d-5cda-46bc-9700-f7081900965c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.380734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922b1d-5cda-46bc-9700-f7081900965c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.381015 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922b1d-5cda-46bc-9700-f7081900965c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.411102 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-29922b1d-5cda-46bc-9700-f7081900965c None None] MFA Rules not processed for user `620b8e6ce8b34987be887614c698b182`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:27.412432 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-29922b1d-5cda-46bc-9700-f7081900965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:27.431596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:27.481490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1304/2602] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:27.492028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:27.493771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:27.572138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5946ac7-bf4b-4b60-8c37-8e69360ff8d2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:27.578830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:27.579647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:27.579935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:27.580219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:27.588919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:27.590626 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:27.600780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1299/2603] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:28.362974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29922b1d-5cda-46bc-9700-f7081900965c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:28.365698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-29922b1d-5cda-46bc-9700-f7081900965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:28.430036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29922b1d-5cda-46bc-9700-f7081900965c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:28.433954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:28.434591 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:28.434872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:28.435143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:28.437207 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:28.448071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:28.449508 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:28.458321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1305/2604] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:30.458703 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:30.460268 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:30.530640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:30.537656 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811a099-53fc-4786-ac76-5b1f3135fcef service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:30.542647 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:30.543305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:30.543616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:30.543888 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] PATH_INFO: `/v3/users/de3ad14b526247d5b60dc22b88b56255` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:30.564134 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3ad14b526247d5b60dc22b88b56255)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:30.566246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:30.617608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3ad14b526247d5b60dc22b88b56255'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:30.626023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3ad14b526247d5b60dc22b88b56255'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:30.626731 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3ad14b526247d5b60dc22b88b56255'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:30.639097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3ad14b526247d5b60dc22b88b56255'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:30.640289 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30c2f194-5f94-477f-ac10-7448b2753a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3ad14b526247d5b60dc22b88b56255'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:30.656999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1300/2605] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:30 2022] DELETE /identity/v3/users/de3ad14b526247d5b60dc22b88b56255 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:30.835627 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:30.846890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c8fcd-4cd5-4e17-a1c2-f58c9ada4f8b service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:30.908554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:30.909213 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:30.909475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:30.909750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] PATH_INFO: `/v3/projects/77cd3a50f7084a70a205159c761bae1d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:30.921551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77cd3a50f7084a70a205159c761bae1d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:30.923294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:30.971926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77cd3a50f7084a70a205159c761bae1d', 'request_id': 'req-496aadfb-1835-4bdd-a24b-7f233592a434'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:30.980384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77cd3a50f7084a70a205159c761bae1d', 'request_id': 'req-496aadfb-1835-4bdd-a24b-7f233592a434'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:30.981828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:30.988581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77cd3a50f7084a70a205159c761bae1d', 'request_id': 'req-496aadfb-1835-4bdd-a24b-7f233592a434'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:31.004204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] The token cache is being invalidate because project 77cd3a50f7084a70a205159c761bae1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:31.004596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:31.005294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-496aadfb-1835-4bdd-a24b-7f233592a434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:31.007867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1306/2606] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:30 2022] DELETE /identity/v3/projects/77cd3a50f7084a70a205159c761bae1d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:31.014392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879eb14d-5ca4-4bdf-b852-d157696786ae None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.014948 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879eb14d-5ca4-4bdf-b852-d157696786ae None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.015541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879eb14d-5ca4-4bdf-b852-d157696786ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.042899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-879eb14d-5ca4-4bdf-b852-d157696786ae None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:31.044165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-879eb14d-5ca4-4bdf-b852-d157696786ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:31.111727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1301/2607] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:31.120769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9cfcd-630f-4d0b-807f-75ac531e74ac None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.121064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9cfcd-630f-4d0b-807f-75ac531e74ac None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.121344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9cfcd-630f-4d0b-807f-75ac531e74ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.141542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c3d9cfcd-630f-4d0b-807f-75ac531e74ac None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:31.142876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c3d9cfcd-630f-4d0b-807f-75ac531e74ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:31.151292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1307/2608] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:31.156131 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879eb14d-5ca4-4bdf-b852-d157696786ae None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:31.165723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879eb14d-5ca4-4bdf-b852-d157696786ae None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:31.170798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:31.171529 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.171813 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.172095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.172806 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:31.173115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:31.174715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:31.187347 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1302/2609] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:48:31.191867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9cfcd-630f-4d0b-807f-75ac531e74ac None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:31.201195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9cfcd-630f-4d0b-807f-75ac531e74ac None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:31.205821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0cc6-8d4a-4b6f-8140-1db3559e42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:31.206426 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0cc6-8d4a-4b6f-8140-1db3559e42e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.206702 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0cc6-8d4a-4b6f-8140-1db3559e42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.206973 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0cc6-8d4a-4b6f-8140-1db3559e42e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.207749 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0cc6-8d4a-4b6f-8140-1db3559e42e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:31.209746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0cc6-8d4a-4b6f-8140-1db3559e42e6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:31.237792 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1308/2610] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:31 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:31.241889 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:31.252891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924572b-f19c-438e-89b6-e667f6e416b9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:31.302660 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:31.318375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7562f51-0e83-4970-8cd2-6484ff4b8757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:31.318828 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7562f51-0e83-4970-8cd2-6484ff4b8757 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.319139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7562f51-0e83-4970-8cd2-6484ff4b8757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.319446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7562f51-0e83-4970-8cd2-6484ff4b8757 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.320165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7562f51-0e83-4970-8cd2-6484ff4b8757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:31.322105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7562f51-0e83-4970-8cd2-6484ff4b8757 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:31.345208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1303/2611] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:31 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:31.350006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0cc6-8d4a-4b6f-8140-1db3559e42e6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:31.361704 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0cc6-8d4a-4b6f-8140-1db3559e42e6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:31.366556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e80ba-6a61-4c91-bba3-d8de76a2987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:31.367203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e80ba-6a61-4c91-bba3-d8de76a2987c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.367523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e80ba-6a61-4c91-bba3-d8de76a2987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.367821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e80ba-6a61-4c91-bba3-d8de76a2987c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.368521 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e80ba-6a61-4c91-bba3-d8de76a2987c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:31.370119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e80ba-6a61-4c91-bba3-d8de76a2987c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:31.381283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1309/2612] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:31.386028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7562f51-0e83-4970-8cd2-6484ff4b8757 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:31.397422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7562f51-0e83-4970-8cd2-6484ff4b8757 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:31.404650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de52661-d12d-461d-8379-ebb0b320a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:31.405830 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de52661-d12d-461d-8379-ebb0b320a758 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.406315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de52661-d12d-461d-8379-ebb0b320a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.406491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de52661-d12d-461d-8379-ebb0b320a758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.407202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de52661-d12d-461d-8379-ebb0b320a758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:31.408949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de52661-d12d-461d-8379-ebb0b320a758 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:31.422407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1304/2613] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:31.426988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e80ba-6a61-4c91-bba3-d8de76a2987c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:31.439878 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e80ba-6a61-4c91-bba3-d8de76a2987c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:31.445250 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:31.445927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.446210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.446486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] PATH_INFO: `/v3/projects/7d8fee01202e49d9bc6856a6f94e9dc1/users/11c4b7fe92cd43b0bcd83ad2b9139ac5/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.464861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8fee01202e49d9bc6856a6f94e9dc1, user_id=11c4b7fe92cd43b0bcd83ad2b9139ac5, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:31.467608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:31.481046 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1310/2614] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:31 2022] PUT /identity/v3/projects/7d8fee01202e49d9bc6856a6f94e9dc1/users/11c4b7fe92cd43b0bcd83ad2b9139ac5/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:31.486618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26277b2-de2f-4a90-8e72-2a8b5d4e99fe None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.487130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26277b2-de2f-4a90-8e72-2a8b5d4e99fe None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.487239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26277b2-de2f-4a90-8e72-2a8b5d4e99fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.507971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f26277b2-de2f-4a90-8e72-2a8b5d4e99fe None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:31.509193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f26277b2-de2f-4a90-8e72-2a8b5d4e99fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:31.569512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1305/2615] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:31.580712 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:31.582553 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:31.641714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1687-3e60-46fb-9432-1057d513b11b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:31.651675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556a28f-42b8-4777-b439-3e4f6af640a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:31.651675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556a28f-42b8-4777-b439-3e4f6af640a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:31.651675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556a28f-42b8-4777-b439-3e4f6af640a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:31.651675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556a28f-42b8-4777-b439-3e4f6af640a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:31.661605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556a28f-42b8-4777-b439-3e4f6af640a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:31.663433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556a28f-42b8-4777-b439-3e4f6af640a3 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:31.673803 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1311/2616] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:32.333681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801cd6a-56f3-47ac-9287-3373408de085 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:32.333974 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801cd6a-56f3-47ac-9287-3373408de085 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:32.334280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801cd6a-56f3-47ac-9287-3373408de085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:32.364249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e801cd6a-56f3-47ac-9287-3373408de085 None None] MFA Rules not processed for user `11c4b7fe92cd43b0bcd83ad2b9139ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:32.365771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e801cd6a-56f3-47ac-9287-3373408de085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:32.439930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1306/2617] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:32.444313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556a28f-42b8-4777-b439-3e4f6af640a3 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:32.454555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556a28f-42b8-4777-b439-3e4f6af640a3 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:32.459281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb49c5-dd25-47ed-b1d0-67d53ca064ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:32.459863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb49c5-dd25-47ed-b1d0-67d53ca064ad admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:32.460145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb49c5-dd25-47ed-b1d0-67d53ca064ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:32.460416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb49c5-dd25-47ed-b1d0-67d53ca064ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:32.461075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb49c5-dd25-47ed-b1d0-67d53ca064ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:32.462966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb49c5-dd25-47ed-b1d0-67d53ca064ad admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:32.491234 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1312/2618] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:32 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:32.495153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801cd6a-56f3-47ac-9287-3373408de085 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:32.508181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801cd6a-56f3-47ac-9287-3373408de085 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:32.568904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a59f6-a230-4c2c-b040-3a1457dd2c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:32.569534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a59f6-a230-4c2c-b040-3a1457dd2c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:32.569815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a59f6-a230-4c2c-b040-3a1457dd2c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:32.570094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a59f6-a230-4c2c-b040-3a1457dd2c5d admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:32.570776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a59f6-a230-4c2c-b040-3a1457dd2c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:32.572737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a59f6-a230-4c2c-b040-3a1457dd2c5d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:32.580775 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:32.595522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1307/2619] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:32 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:32.599810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb49c5-dd25-47ed-b1d0-67d53ca064ad admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:32.610622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb49c5-dd25-47ed-b1d0-67d53ca064ad admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:32.618077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68733f-5a55-436b-8f05-0e4a3cc529b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:32.618697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68733f-5a55-436b-8f05-0e4a3cc529b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:32.618974 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68733f-5a55-436b-8f05-0e4a3cc529b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:32.619245 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68733f-5a55-436b-8f05-0e4a3cc529b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:32.619954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68733f-5a55-436b-8f05-0e4a3cc529b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:32.621562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68733f-5a55-436b-8f05-0e4a3cc529b4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:32.633576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1313/2620] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:32.637905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a59f6-a230-4c2c-b040-3a1457dd2c5d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:32.648142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a59f6-a230-4c2c-b040-3a1457dd2c5d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:32.652737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989b7e8-df93-4dd6-8d8a-65be1e74de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:32.653399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989b7e8-df93-4dd6-8d8a-65be1e74de72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:32.653681 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989b7e8-df93-4dd6-8d8a-65be1e74de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:32.653982 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989b7e8-df93-4dd6-8d8a-65be1e74de72 admin admin] PATH_INFO: `/v3/projects/ffc141a4def246f3b8e7babdfc917610/users/03ce3981f62f4de2b6404c1566248258/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:32.670116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989b7e8-df93-4dd6-8d8a-65be1e74de72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc141a4def246f3b8e7babdfc917610, user_id=03ce3981f62f4de2b6404c1566248258, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:32.673317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989b7e8-df93-4dd6-8d8a-65be1e74de72 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:32.687444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1308/2621] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:32 2022] PUT /identity/v3/projects/ffc141a4def246f3b8e7babdfc917610/users/03ce3981f62f4de2b6404c1566248258/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:32.691545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68733f-5a55-436b-8f05-0e4a3cc529b4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:32.701833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68733f-5a55-436b-8f05-0e4a3cc529b4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:32.748263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:32.760126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:32.760775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:32.761107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:32.761395 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:32.762334 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:32.764062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:32.774044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1314/2622] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:32.778428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989b7e8-df93-4dd6-8d8a-65be1e74de72 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:32.789572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989b7e8-df93-4dd6-8d8a-65be1e74de72 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:32.794353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e5ea7-3004-4347-8fe4-771209ed9f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:32.795010 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5ea7-3004-4347-8fe4-771209ed9f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:32.795336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5ea7-3004-4347-8fe4-771209ed9f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:32.796228 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5ea7-3004-4347-8fe4-771209ed9f4d admin admin] PATH_INFO: `/v3/projects/ffc141a4def246f3b8e7babdfc917610/users/03ce3981f62f4de2b6404c1566248258/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:32.798221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e5ea7-3004-4347-8fe4-771209ed9f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc141a4def246f3b8e7babdfc917610, user_id=03ce3981f62f4de2b6404c1566248258, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:32.801094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e5ea7-3004-4347-8fe4-771209ed9f4d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:32.812821 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1309/2623] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:32 2022] PUT /identity/v3/projects/ffc141a4def246f3b8e7babdfc917610/users/03ce3981f62f4de2b6404c1566248258/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:32.947277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:32.949427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:32.964247 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54ae01-bd3b-4900-b376-52a8c0a464ed admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:33.036006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:33.037134 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:33.037617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:33.038120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] PATH_INFO: `/v3/users/620b8e6ce8b34987be887614c698b182` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:33.040393 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620b8e6ce8b34987be887614c698b182)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:33.042368 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:33.093988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620b8e6ce8b34987be887614c698b182'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.102705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620b8e6ce8b34987be887614c698b182'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.110933 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620b8e6ce8b34987be887614c698b182'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.111818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620b8e6ce8b34987be887614c698b182'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.123947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620b8e6ce8b34987be887614c698b182'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.131667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1315/2624] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:32 2022] DELETE /identity/v3/users/620b8e6ce8b34987be887614c698b182 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:33.135978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e194e-e02a-4319-87b9-9b1f9b9d9310 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:33.136336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e194e-e02a-4319-87b9-9b1f9b9d9310 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:33.136710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e194e-e02a-4319-87b9-9b1f9b9d9310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:33.191303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-339e194e-e02a-4319-87b9-9b1f9b9d9310 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:33.193709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-339e194e-e02a-4319-87b9-9b1f9b9d9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:33.278176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1310/2625] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:33.288297 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:33.289856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:33.354238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3f313-e852-4b4f-bf12-0ef857e82d66 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:33.358434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:33.359095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:33.359398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:33.359707 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:33.371307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:33.372900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:33.383811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1316/2626] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:33.504473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a203-0179-429e-9e12-2204110a50b6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:33.504992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a203-0179-429e-9e12-2204110a50b6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:33.505457 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a203-0179-429e-9e12-2204110a50b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:33.543094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3791a203-0179-429e-9e12-2204110a50b6 None None] MFA Rules not processed for user `03ce3981f62f4de2b6404c1566248258`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:33.546727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3791a203-0179-429e-9e12-2204110a50b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:33.639344 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1311/2627] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:33.696442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:33.698193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:33.712206 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f941-4c64-43b0-8eb8-1ee0d991fe51 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:33.721109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:33.721763 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:33.722096 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:33.722391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] PATH_INFO: `/v3/projects/aad0801c5e4442f8a0ec3ee13c6009e0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:33.723762 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad0801c5e4442f8a0ec3ee13c6009e0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:33.725666 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:33.728385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:33.780939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad0801c5e4442f8a0ec3ee13c6009e0', 'request_id': 'req-7019eeff-c301-4e6a-bfb0-7c95075f984e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.792457 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad0801c5e4442f8a0ec3ee13c6009e0', 'request_id': 'req-7019eeff-c301-4e6a-bfb0-7c95075f984e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.799929 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad0801c5e4442f8a0ec3ee13c6009e0', 'request_id': 'req-7019eeff-c301-4e6a-bfb0-7c95075f984e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.812483 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] The token cache is being invalidate because project aad0801c5e4442f8a0ec3ee13c6009e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:33.812775 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.813434 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7019eeff-c301-4e6a-bfb0-7c95075f984e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:33.814951 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1317/2628] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:33 2022] DELETE /identity/v3/projects/aad0801c5e4442f8a0ec3ee13c6009e0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:33.820441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54a35-2d5e-4905-80dc-e74cb6ab2c7f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:33.820726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54a35-2d5e-4905-80dc-e74cb6ab2c7f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:33.821386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54a35-2d5e-4905-80dc-e74cb6ab2c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:33.841339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8dc54a35-2d5e-4905-80dc-e74cb6ab2c7f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:33.843827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8dc54a35-2d5e-4905-80dc-e74cb6ab2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:33.881967 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:33.916040 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1312/2629] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:33.925188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec56a9-3d2a-427a-a148-be5562a0ab2f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:33.925475 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec56a9-3d2a-427a-a148-be5562a0ab2f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:33.925786 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec56a9-3d2a-427a-a148-be5562a0ab2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:33.946401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-09ec56a9-3d2a-427a-a148-be5562a0ab2f None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:33.947652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-09ec56a9-3d2a-427a-a148-be5562a0ab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:33.956153 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1318/2630] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:33.960479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc54a35-2d5e-4905-80dc-e74cb6ab2c7f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:33.971165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc54a35-2d5e-4905-80dc-e74cb6ab2c7f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:33.978467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:33.979111 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:33.979413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:33.979704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:33.980411 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:33.980717 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:33.982332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:33.997899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1313/2631] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:48:33.999502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec56a9-3d2a-427a-a148-be5562a0ab2f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:34.012078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec56a9-3d2a-427a-a148-be5562a0ab2f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:34.017617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5e3f-88d1-43b6-9b9d-a6af92011a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:34.018318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5e3f-88d1-43b6-9b9d-a6af92011a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.018705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5e3f-88d1-43b6-9b9d-a6af92011a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.019042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5e3f-88d1-43b6-9b9d-a6af92011a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.019822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a5e3f-88d1-43b6-9b9d-a6af92011a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:34.021791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a5e3f-88d1-43b6-9b9d-a6af92011a8e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:34.050164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1319/2632] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:33 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:34.054486 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:34.064925 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9de57-d1e6-4e84-b97e-8f3b6de3bedf admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:34.126210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a0b6-deab-4311-bb77-f9030c9b41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:34.126852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a0b6-deab-4311-bb77-f9030c9b41dc admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.127137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a0b6-deab-4311-bb77-f9030c9b41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.127471 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a0b6-deab-4311-bb77-f9030c9b41dc admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.128159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1a0b6-deab-4311-bb77-f9030c9b41dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:34.130418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1a0b6-deab-4311-bb77-f9030c9b41dc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:34.157172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1314/2633] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:34 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:34.158401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5e3f-88d1-43b6-9b9d-a6af92011a8e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:34.169954 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5e3f-88d1-43b6-9b9d-a6af92011a8e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:34.175939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648aefc-de2b-42e9-88c5-e97978734ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:34.176565 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648aefc-de2b-42e9-88c5-e97978734ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.176851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648aefc-de2b-42e9-88c5-e97978734ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.177128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648aefc-de2b-42e9-88c5-e97978734ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.177846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648aefc-de2b-42e9-88c5-e97978734ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:34.179472 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648aefc-de2b-42e9-88c5-e97978734ca7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:34.192774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1320/2634] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:34.198070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a0b6-deab-4311-bb77-f9030c9b41dc admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:34.221479 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a0b6-deab-4311-bb77-f9030c9b41dc admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:34.229243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfa230-06c1-4ee6-8ebf-31ca333219a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:34.230305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa230-06c1-4ee6-8ebf-31ca333219a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.230794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa230-06c1-4ee6-8ebf-31ca333219a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.231277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa230-06c1-4ee6-8ebf-31ca333219a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.237254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfa230-06c1-4ee6-8ebf-31ca333219a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:34.237254 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfa230-06c1-4ee6-8ebf-31ca333219a8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:34.255038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1315/2635] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:34.259278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648aefc-de2b-42e9-88c5-e97978734ca7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:34.269851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648aefc-de2b-42e9-88c5-e97978734ca7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:34.274691 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:34.275476 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.275824 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.276171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] PATH_INFO: `/v3/projects/e71516acd72744b39b8a508b896608a1/users/d74bd4cece4849ea8860e0c2f2ad3c50/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.292577 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71516acd72744b39b8a508b896608a1, user_id=d74bd4cece4849ea8860e0c2f2ad3c50, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:34.295367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:34.313687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1321/2636] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:34 2022] PUT /identity/v3/projects/e71516acd72744b39b8a508b896608a1/users/d74bd4cece4849ea8860e0c2f2ad3c50/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:34.324296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73f0d-8fde-463e-89b0-c68cba230a10 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.324590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73f0d-8fde-463e-89b0-c68cba230a10 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.324870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73f0d-8fde-463e-89b0-c68cba230a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.353606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2df73f0d-8fde-463e-89b0-c68cba230a10 None None] MFA Rules not processed for user `d74bd4cece4849ea8860e0c2f2ad3c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:34.354838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2df73f0d-8fde-463e-89b0-c68cba230a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:34.424620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1316/2637] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:34.442624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:34.444629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:34.520779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642650-8384-4790-bf70-5b49256380c2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:34.526404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c93c-f106-449a-84da-159e83747111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:34.527034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c93c-f106-449a-84da-159e83747111 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.527325 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c93c-f106-449a-84da-159e83747111 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.527629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c93c-f106-449a-84da-159e83747111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.536421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c93c-f106-449a-84da-159e83747111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:34.538013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c93c-f106-449a-84da-159e83747111 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:34.548143 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1322/2638] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:34.766638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df73f0d-8fde-463e-89b0-c68cba230a10 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:34.769180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2df73f0d-8fde-463e-89b0-c68cba230a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:34.796540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c93c-f106-449a-84da-159e83747111 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:34.811121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:34.817452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:34.852017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df73f0d-8fde-463e-89b0-c68cba230a10 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:34.856520 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:34.857157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.857436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.857723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] PATH_INFO: `/v3/users/11c4b7fe92cd43b0bcd83ad2b9139ac5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.858883 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c4b7fe92cd43b0bcd83ad2b9139ac5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:34.861075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:34.866551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c93c-f106-449a-84da-159e83747111 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:34.871558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:34.872371 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.872658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.872939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] PATH_INFO: `/v3/users/d74bd4cece4849ea8860e0c2f2ad3c50` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:34.874237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74bd4cece4849ea8860e0c2f2ad3c50)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:34.876212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:34.915619 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c4b7fe92cd43b0bcd83ad2b9139ac5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.924853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c4b7fe92cd43b0bcd83ad2b9139ac5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.925969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c4b7fe92cd43b0bcd83ad2b9139ac5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.929772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74bd4cece4849ea8860e0c2f2ad3c50'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.939905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74bd4cece4849ea8860e0c2f2ad3c50'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.944785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c4b7fe92cd43b0bcd83ad2b9139ac5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.945545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cb3f307-be84-4866-b42a-563278bb0b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c4b7fe92cd43b0bcd83ad2b9139ac5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.948901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74bd4cece4849ea8860e0c2f2ad3c50'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.949585 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74bd4cece4849ea8860e0c2f2ad3c50'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.959915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1317/2639] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:34 2022] DELETE /identity/v3/users/11c4b7fe92cd43b0bcd83ad2b9139ac5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:34.966019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74bd4cece4849ea8860e0c2f2ad3c50'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:34.972917 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1323/2640] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:34 2022] DELETE /identity/v3/users/d74bd4cece4849ea8860e0c2f2ad3c50 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:34.977527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa7dcb-86be-4a9f-9058-1e9f63e4519b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:34.977815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa7dcb-86be-4a9f-9058-1e9f63e4519b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:34.978232 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa7dcb-86be-4a9f-9058-1e9f63e4519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.002615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7ffa7dcb-86be-4a9f-9058-1e9f63e4519b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:35.003870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7ffa7dcb-86be-4a9f-9058-1e9f63e4519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:35.084678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1318/2641] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:35.094883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:35.096443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:35.158698 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa7dcb-86be-4a9f-9058-1e9f63e4519b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:35.160422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7ffa7dcb-86be-4a9f-9058-1e9f63e4519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:35.161488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d106d-6b26-4988-a140-e12bd71cbc30 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:35.166765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866dd1f-1d5d-4359-8230-f2f6047dbcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:35.167515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866dd1f-1d5d-4359-8230-f2f6047dbcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.168111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866dd1f-1d5d-4359-8230-f2f6047dbcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.168600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866dd1f-1d5d-4359-8230-f2f6047dbcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.175702 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa7dcb-86be-4a9f-9058-1e9f63e4519b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:35.179776 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866dd1f-1d5d-4359-8230-f2f6047dbcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:35.180548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:35.181446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.181725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.181833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866dd1f-1d5d-4359-8230-f2f6047dbcf2 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:35.182570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] PATH_INFO: `/v3/projects/7d8fee01202e49d9bc6856a6f94e9dc1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.184051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8fee01202e49d9bc6856a6f94e9dc1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:35.186558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:35.195025 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1324/2642] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:35.235257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:35.236885 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8fee01202e49d9bc6856a6f94e9dc1', 'request_id': 'req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.252308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8fee01202e49d9bc6856a6f94e9dc1', 'request_id': 'req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.258979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8fee01202e49d9bc6856a6f94e9dc1', 'request_id': 'req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.274265 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] The token cache is being invalidate because project 7d8fee01202e49d9bc6856a6f94e9dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:35.274653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.275424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.277164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1319/2643] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:35 2022] DELETE /identity/v3/projects/7d8fee01202e49d9bc6856a6f94e9dc1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:35.281353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866dd1f-1d5d-4359-8230-f2f6047dbcf2 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:35.299926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866dd1f-1d5d-4359-8230-f2f6047dbcf2 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:35.342769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:35.380829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:35.381510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.381788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.382068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] PATH_INFO: `/v3/users/03ce3981f62f4de2b6404c1566248258` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.383407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ce3981f62f4de2b6404c1566248258)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:35.385490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:35.442225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ce3981f62f4de2b6404c1566248258'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.451285 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ce3981f62f4de2b6404c1566248258'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.459759 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ce3981f62f4de2b6404c1566248258'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.460637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ce3981f62f4de2b6404c1566248258'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.473161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ce3981f62f4de2b6404c1566248258'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.479100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1325/2644] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:35 2022] DELETE /identity/v3/users/03ce3981f62f4de2b6404c1566248258 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:35.514165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:35.516073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:35.537298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5b24-1e05-4e44-b1a7-d9513dcaf29a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:35.623001 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:35.624518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.624892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.625573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] PATH_INFO: `/v3/projects/e71516acd72744b39b8a508b896608a1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.626761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71516acd72744b39b8a508b896608a1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:35.629026 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:35.680467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71516acd72744b39b8a508b896608a1', 'request_id': 'req-9a820805-b5c0-4792-9808-93ad649f1824'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.688439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71516acd72744b39b8a508b896608a1', 'request_id': 'req-9a820805-b5c0-4792-9808-93ad649f1824'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.697031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71516acd72744b39b8a508b896608a1', 'request_id': 'req-9a820805-b5c0-4792-9808-93ad649f1824'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.707455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:35.709219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:35.715167 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] The token cache is being invalidate because project e71516acd72744b39b8a508b896608a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:35.715505 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.716165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9a820805-b5c0-4792-9808-93ad649f1824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.718281 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1320/2645] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:35 2022] DELETE /identity/v3/projects/e71516acd72744b39b8a508b896608a1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:35.723058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a68e6-ffd8-4025-b474-4858fc0a2501 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:35.723853 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491f7e-ff03-4703-85b8-74c6ffb03435 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.724260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491f7e-ff03-4703-85b8-74c6ffb03435 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.724618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491f7e-ff03-4703-85b8-74c6ffb03435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.747913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a8491f7e-ff03-4703-85b8-74c6ffb03435 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:35.749906 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a8491f7e-ff03-4703-85b8-74c6ffb03435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:35.785279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:35.786030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.786202 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.786525 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] PATH_INFO: `/v3/projects/ffc141a4def246f3b8e7babdfc917610` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.787739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc141a4def246f3b8e7babdfc917610)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:35.789801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:35.812028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1321/2646] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:35.820138 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a05d1d-76b4-445d-90fe-02d55c9f3cc8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.820434 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a05d1d-76b4-445d-90fe-02d55c9f3cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.820715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a05d1d-76b4-445d-90fe-02d55c9f3cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.836707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:35.841066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc141a4def246f3b8e7babdfc917610', 'request_id': 'req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.841554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b0a05d1d-76b4-445d-90fe-02d55c9f3cc8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:35.843598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b0a05d1d-76b4-445d-90fe-02d55c9f3cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:35.851808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc141a4def246f3b8e7babdfc917610', 'request_id': 'req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.853592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:35.860901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc141a4def246f3b8e7babdfc917610', 'request_id': 'req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.875342 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] The token cache is being invalidate because project ffc141a4def246f3b8e7babdfc917610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:35.875581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.876229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d1f7ea1f-73e5-4d7e-aa7f-318245be9e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:35.877928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1326/2647] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:35 2022] DELETE /identity/v3/projects/ffc141a4def246f3b8e7babdfc917610 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:35.882801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6cb0-e6ef-4d0e-b368-0cd7d4218097 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.883083 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6cb0-e6ef-4d0e-b368-0cd7d4218097 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.883359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6cb0-e6ef-4d0e-b368-0cd7d4218097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.902555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fd9f6cb0-e6ef-4d0e-b368-0cd7d4218097 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:35.904200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fd9f6cb0-e6ef-4d0e-b368-0cd7d4218097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:35.916238 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1322/2648] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:35.921149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a05d1d-76b4-445d-90fe-02d55c9f3cc8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:35.929941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a05d1d-76b4-445d-90fe-02d55c9f3cc8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:35.934831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:35.935453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.935740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.936018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.936706 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:35.937009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:35.938608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:35.950650 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1323/2649] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:48:35.955053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:35.964708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967097e-dfc8-4b22-98b0-d85bfad76b14 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:35.969444 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1327/2650] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:35.969905 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b262c06-cb7e-40ab-be44-e23c585b4628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:35.970518 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262c06-cb7e-40ab-be44-e23c585b4628 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.970803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262c06-cb7e-40ab-be44-e23c585b4628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.971080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262c06-cb7e-40ab-be44-e23c585b4628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:35.971937 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b262c06-cb7e-40ab-be44-e23c585b4628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:35.973858 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b262c06-cb7e-40ab-be44-e23c585b4628 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:35.980857 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755330c8-7d4b-41ad-96ba-30b93b8c0b3e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:35.981145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755330c8-7d4b-41ad-96ba-30b93b8c0b3e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:35.981421 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755330c8-7d4b-41ad-96ba-30b93b8c0b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.003982 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-755330c8-7d4b-41ad-96ba-30b93b8c0b3e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:36.004781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1324/2651] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:35 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:36.005509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-755330c8-7d4b-41ad-96ba-30b93b8c0b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:36.009104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b262c06-cb7e-40ab-be44-e23c585b4628 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.071087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1328/2652] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:36.075490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755330c8-7d4b-41ad-96ba-30b93b8c0b3e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.075683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b262c06-cb7e-40ab-be44-e23c585b4628 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.080208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c502078-181a-47f8-adbc-6ebdd7092a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.080833 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c502078-181a-47f8-adbc-6ebdd7092a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.081113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c502078-181a-47f8-adbc-6ebdd7092a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.081387 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c502078-181a-47f8-adbc-6ebdd7092a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.082049 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c502078-181a-47f8-adbc-6ebdd7092a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.084118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c502078-181a-47f8-adbc-6ebdd7092a63 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.084647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755330c8-7d4b-41ad-96ba-30b93b8c0b3e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.089273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.089866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.090150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.090428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.091262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:36.091602 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.093890 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.106262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1329/2653] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:48:36.111545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1325/2654] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:36.111687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.112639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c502078-181a-47f8-adbc-6ebdd7092a63 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.121284 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7b10c-0483-4cff-be28-9b2883a12555 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.122338 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c502078-181a-47f8-adbc-6ebdd7092a63 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.126026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff9f28-00fe-4d06-8569-8097cc362ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.126550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff9f28-00fe-4d06-8569-8097cc362ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.126826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff9f28-00fe-4d06-8569-8097cc362ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.127097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff9f28-00fe-4d06-8569-8097cc362ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.127779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff9f28-00fe-4d06-8569-8097cc362ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.128196 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33b45-4e5f-47cf-8bf2-bd6db932d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.129339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33b45-4e5f-47cf-8bf2-bd6db932d2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.129339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33b45-4e5f-47cf-8bf2-bd6db932d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.129668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff9f28-00fe-4d06-8569-8097cc362ab4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.129779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33b45-4e5f-47cf-8bf2-bd6db932d2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.130622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be33b45-4e5f-47cf-8bf2-bd6db932d2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.132359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be33b45-4e5f-47cf-8bf2-bd6db932d2ce admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.143584 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1326/2655] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:36.147549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33b45-4e5f-47cf-8bf2-bd6db932d2ce admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.158209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33b45-4e5f-47cf-8bf2-bd6db932d2ce admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.158862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1330/2656] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:36.164365 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff9f28-00fe-4d06-8569-8097cc362ab4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.210055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:36.216502 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:36.223135 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd71c0-6db4-4d19-8145-160ce97f938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.223799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd71c0-6db4-4d19-8145-160ce97f938a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.224153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd71c0-6db4-4d19-8145-160ce97f938a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.224356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd71c0-6db4-4d19-8145-160ce97f938a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.225051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd71c0-6db4-4d19-8145-160ce97f938a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.226666 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd71c0-6db4-4d19-8145-160ce97f938a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.231196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff9f28-00fe-4d06-8569-8097cc362ab4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.236891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1327/2657] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:36.241470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd71c0-6db4-4d19-8145-160ce97f938a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.241610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622d3a-5d33-4676-960c-98f9262d8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.242279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622d3a-5d33-4676-960c-98f9262d8160 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.242641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622d3a-5d33-4676-960c-98f9262d8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.242987 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622d3a-5d33-4676-960c-98f9262d8160 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.243888 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe622d3a-5d33-4676-960c-98f9262d8160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.245900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe622d3a-5d33-4676-960c-98f9262d8160 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.252677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd71c0-6db4-4d19-8145-160ce97f938a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.258207 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1254c-6b9b-408e-896b-ded4a29f03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.258874 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1254c-6b9b-408e-896b-ded4a29f03cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.259182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1254c-6b9b-408e-896b-ded4a29f03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.259512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1254c-6b9b-408e-896b-ded4a29f03cb admin admin] PATH_INFO: `/v3/projects/678d10ba1a394bf9bc31972954ce8e82/users/a274ac14dae7441b9d076e9ce4ce8cfe/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.268478 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1331/2658] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:36.272574 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622d3a-5d33-4676-960c-98f9262d8160 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.278012 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1254c-6b9b-408e-896b-ded4a29f03cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=678d10ba1a394bf9bc31972954ce8e82, user_id=a274ac14dae7441b9d076e9ce4ce8cfe, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.281259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1254c-6b9b-408e-896b-ded4a29f03cb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.282977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622d3a-5d33-4676-960c-98f9262d8160 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.289001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3c966-ffce-44b7-980b-f8e51a0dd518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.289001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3c966-ffce-44b7-980b-f8e51a0dd518 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.289265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3c966-ffce-44b7-980b-f8e51a0dd518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.289380 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3c966-ffce-44b7-980b-f8e51a0dd518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.290098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3c966-ffce-44b7-980b-f8e51a0dd518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.291804 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3c966-ffce-44b7-980b-f8e51a0dd518 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.296110 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1328/2659] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:36 2022] PUT /identity/v3/projects/678d10ba1a394bf9bc31972954ce8e82/users/a274ac14dae7441b9d076e9ce4ce8cfe/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:36.305119 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1332/2660] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:48:36.306730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1254c-6b9b-408e-896b-ded4a29f03cb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.307756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b731-63b1-4059-82a9-b5a02b667100 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.308199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b731-63b1-4059-82a9-b5a02b667100 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.308509 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b731-63b1-4059-82a9-b5a02b667100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.337818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-93c6b731-63b1-4059-82a9-b5a02b667100 None None] MFA Rules not processed for user `a274ac14dae7441b9d076e9ce4ce8cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:36.339114 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-93c6b731-63b1-4059-82a9-b5a02b667100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:36.370710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1254c-6b9b-408e-896b-ded4a29f03cb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.377482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ae03-943e-48c8-9aec-c8beb1614281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.378038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ae03-943e-48c8-9aec-c8beb1614281 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.378321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ae03-943e-48c8-9aec-c8beb1614281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.378605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ae03-943e-48c8-9aec-c8beb1614281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.379305 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753ae03-943e-48c8-9aec-c8beb1614281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.380959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753ae03-943e-48c8-9aec-c8beb1614281 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.392478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1329/2661] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:36.396979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ae03-943e-48c8-9aec-c8beb1614281 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.407597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1333/2662] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:36.408018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ae03-943e-48c8-9aec-c8beb1614281 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.411977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6b731-63b1-4059-82a9-b5a02b667100 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.413345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e95414-d1d2-4a4f-b138-944a228915ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.414017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e95414-d1d2-4a4f-b138-944a228915ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.414303 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e95414-d1d2-4a4f-b138-944a228915ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.414580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e95414-d1d2-4a4f-b138-944a228915ef admin admin] PATH_INFO: `/v3/projects/07a098db6dd44e46a4bde772c00be747/users/9dee4226043343bc8b93e4c836bb5841/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.422671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6b731-63b1-4059-82a9-b5a02b667100 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.427456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5b19a-7803-491f-899f-2dbf4e36f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.428069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5b19a-7803-491f-899f-2dbf4e36f11f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.428348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5b19a-7803-491f-899f-2dbf4e36f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.428624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5b19a-7803-491f-899f-2dbf4e36f11f admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.429284 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5b19a-7803-491f-899f-2dbf4e36f11f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.429949 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e95414-d1d2-4a4f-b138-944a228915ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a098db6dd44e46a4bde772c00be747, user_id=9dee4226043343bc8b93e4c836bb5841, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.431465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5b19a-7803-491f-899f-2dbf4e36f11f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.432882 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e95414-d1d2-4a4f-b138-944a228915ef admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.450154 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1330/2663] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:36 2022] PUT /identity/v3/projects/07a098db6dd44e46a4bde772c00be747/users/9dee4226043343bc8b93e4c836bb5841/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:36.461944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631428c7-ac7e-4216-82e6-83bf12312dc8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.462128 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1334/2664] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:36.462462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631428c7-ac7e-4216-82e6-83bf12312dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.462745 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631428c7-ac7e-4216-82e6-83bf12312dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.465901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5b19a-7803-491f-899f-2dbf4e36f11f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.491234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-631428c7-ac7e-4216-82e6-83bf12312dc8 None None] MFA Rules not processed for user `9dee4226043343bc8b93e4c836bb5841`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:36.492494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-631428c7-ac7e-4216-82e6-83bf12312dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:36.533306 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5b19a-7803-491f-899f-2dbf4e36f11f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.538447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5722d05-b8ca-4436-b912-34ff14eff810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.539061 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5722d05-b8ca-4436-b912-34ff14eff810 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.539340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5722d05-b8ca-4436-b912-34ff14eff810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.539640 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5722d05-b8ca-4436-b912-34ff14eff810 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.540322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5722d05-b8ca-4436-b912-34ff14eff810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.542214 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5722d05-b8ca-4436-b912-34ff14eff810 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.563642 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1331/2665] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:36.566909 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1335/2666] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:36.568165 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631428c7-ac7e-4216-82e6-83bf12312dc8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.571200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5722d05-b8ca-4436-b912-34ff14eff810 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.579300 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631428c7-ac7e-4216-82e6-83bf12312dc8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.582587 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5722d05-b8ca-4436-b912-34ff14eff810 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.584308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d901-e0ab-47fc-bb0c-328274edfeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.584980 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d901-e0ab-47fc-bb0c-328274edfeff admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.585203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d901-e0ab-47fc-bb0c-328274edfeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.585480 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d901-e0ab-47fc-bb0c-328274edfeff admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.586132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204d901-e0ab-47fc-bb0c-328274edfeff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.587439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c0513-d1ca-45c7-9073-2d79a7dd87f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.588065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204d901-e0ab-47fc-bb0c-328274edfeff admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.588248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c0513-d1ca-45c7-9073-2d79a7dd87f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.588555 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c0513-d1ca-45c7-9073-2d79a7dd87f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.588858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c0513-d1ca-45c7-9073-2d79a7dd87f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.589557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c0513-d1ca-45c7-9073-2d79a7dd87f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.591132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c0513-d1ca-45c7-9073-2d79a7dd87f7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.604231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1336/2667] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:48:36.608733 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c0513-d1ca-45c7-9073-2d79a7dd87f7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.619180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c0513-d1ca-45c7-9073-2d79a7dd87f7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.619919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1332/2668] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:36.624547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d901-e0ab-47fc-bb0c-328274edfeff admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.628840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:36.634408 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:36.682681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c94de1-a3eb-4467-8edf-eb29efa777cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.683353 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c94de1-a3eb-4467-8edf-eb29efa777cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.683669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c94de1-a3eb-4467-8edf-eb29efa777cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.683964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c94de1-a3eb-4467-8edf-eb29efa777cb admin admin] PATH_INFO: `/v3/projects/9b67deb9baf44e43811a5370b545d6bf/users/50f494a74c304e50becbdb1617e4bdb2/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.690550 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d901-e0ab-47fc-bb0c-328274edfeff admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.695256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8ebb9-0956-4b24-91d4-9d31b958084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.695909 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8ebb9-0956-4b24-91d4-9d31b958084b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.696189 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8ebb9-0956-4b24-91d4-9d31b958084b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.696473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8ebb9-0956-4b24-91d4-9d31b958084b admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.697132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8ebb9-0956-4b24-91d4-9d31b958084b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.699055 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8ebb9-0956-4b24-91d4-9d31b958084b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.699323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c94de1-a3eb-4467-8edf-eb29efa777cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b67deb9baf44e43811a5370b545d6bf, user_id=50f494a74c304e50becbdb1617e4bdb2, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.702645 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c94de1-a3eb-4467-8edf-eb29efa777cb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.719396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1337/2669] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:36 2022] PUT /identity/v3/projects/9b67deb9baf44e43811a5370b545d6bf/users/50f494a74c304e50becbdb1617e4bdb2/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:36.723327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1333/2670] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:36.723538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c94de1-a3eb-4467-8edf-eb29efa777cb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.724355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8ebb9-0956-4b24-91d4-9d31b958084b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.733922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8ebb9-0956-4b24-91d4-9d31b958084b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.786600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c94de1-a3eb-4467-8edf-eb29efa777cb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.791659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da257786-f7ff-47d5-9747-343de0240cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.791902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010896-0094-4760-adc8-1f501bf2a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.792282 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da257786-f7ff-47d5-9747-343de0240cea admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.792516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010896-0094-4760-adc8-1f501bf2a026 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.792634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da257786-f7ff-47d5-9747-343de0240cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.792796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010896-0094-4760-adc8-1f501bf2a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.792912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da257786-f7ff-47d5-9747-343de0240cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.793073 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010896-0094-4760-adc8-1f501bf2a026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.793510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da257786-f7ff-47d5-9747-343de0240cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.793764 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010896-0094-4760-adc8-1f501bf2a026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.795154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da257786-f7ff-47d5-9747-343de0240cea admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.795469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010896-0094-4760-adc8-1f501bf2a026 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.805573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1334/2671] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:48:36.806016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1338/2672] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:48:36.810244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010896-0094-4760-adc8-1f501bf2a026 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.810648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da257786-f7ff-47d5-9747-343de0240cea admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.821295 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010896-0094-4760-adc8-1f501bf2a026 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.821865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da257786-f7ff-47d5-9747-343de0240cea admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.826009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64a29-6aee-46ef-94a1-544aede01b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.826146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21647255-7eba-4d01-b5bf-29edc4382105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.827255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64a29-6aee-46ef-94a1-544aede01b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.827479 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21647255-7eba-4d01-b5bf-29edc4382105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.827592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64a29-6aee-46ef-94a1-544aede01b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.827760 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21647255-7eba-4d01-b5bf-29edc4382105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.827870 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64a29-6aee-46ef-94a1-544aede01b3e admin admin] PATH_INFO: `/v3/projects/e40a29d3b4a543de8ce1bcf722ffff09/users/31897d510cc8477392e465ed4e6e64b3/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.828042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21647255-7eba-4d01-b5bf-29edc4382105 admin admin] PATH_INFO: `/v3/projects/9b67deb9baf44e43811a5370b545d6bf/users/50f494a74c304e50becbdb1617e4bdb2/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.830144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21647255-7eba-4d01-b5bf-29edc4382105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b67deb9baf44e43811a5370b545d6bf, user_id=50f494a74c304e50becbdb1617e4bdb2, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.833491 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21647255-7eba-4d01-b5bf-29edc4382105 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.842715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a64a29-6aee-46ef-94a1-544aede01b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40a29d3b4a543de8ce1bcf722ffff09, user_id=31897d510cc8477392e465ed4e6e64b3, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.845244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1339/2673] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:36 2022] PUT /identity/v3/projects/9b67deb9baf44e43811a5370b545d6bf/users/50f494a74c304e50becbdb1617e4bdb2/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:36.845714 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a64a29-6aee-46ef-94a1-544aede01b3e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.855612 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ff75-182e-4d57-9af8-a10d9d43dccc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.855900 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ff75-182e-4d57-9af8-a10d9d43dccc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.856184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ff75-182e-4d57-9af8-a10d9d43dccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.859507 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1335/2674] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:36 2022] PUT /identity/v3/projects/e40a29d3b4a543de8ce1bcf722ffff09/users/31897d510cc8477392e465ed4e6e64b3/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:36.863567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64a29-6aee-46ef-94a1-544aede01b3e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.886323 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9d24ff75-182e-4d57-9af8-a10d9d43dccc None None] MFA Rules not processed for user `50f494a74c304e50becbdb1617e4bdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:36.887514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9d24ff75-182e-4d57-9af8-a10d9d43dccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:36.932834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64a29-6aee-46ef-94a1-544aede01b3e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.937756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b150b3-84c7-47a7-84f1-3d2de9e05c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.938375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b150b3-84c7-47a7-84f1-3d2de9e05c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.938655 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b150b3-84c7-47a7-84f1-3d2de9e05c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.938924 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b150b3-84c7-47a7-84f1-3d2de9e05c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.939662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b150b3-84c7-47a7-84f1-3d2de9e05c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.941277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b150b3-84c7-47a7-84f1-3d2de9e05c56 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.946820 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:36.956023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1336/2675] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:36.956869 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b150b3-84c7-47a7-84f1-3d2de9e05c56 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.963488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1340/2676] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:36.966509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b150b3-84c7-47a7-84f1-3d2de9e05c56 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:36.972081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab2b2c-a48a-43f8-92bb-97244fae2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:36.972788 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2b2c-a48a-43f8-92bb-97244fae2be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:36.973069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2b2c-a48a-43f8-92bb-97244fae2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:36.973350 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2b2c-a48a-43f8-92bb-97244fae2be2 admin admin] PATH_INFO: `/v3/projects/e40a29d3b4a543de8ce1bcf722ffff09/users/31897d510cc8477392e465ed4e6e64b3/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:36.975581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab2b2c-a48a-43f8-92bb-97244fae2be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40a29d3b4a543de8ce1bcf722ffff09, user_id=31897d510cc8477392e465ed4e6e64b3, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:36.976081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ff75-182e-4d57-9af8-a10d9d43dccc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:36.977481 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9d24ff75-182e-4d57-9af8-a10d9d43dccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:36.978239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab2b2c-a48a-43f8-92bb-97244fae2be2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:36.987042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:36.989118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1337/2677] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:36 2022] PUT /identity/v3/projects/e40a29d3b4a543de8ce1bcf722ffff09/users/31897d510cc8477392e465ed4e6e64b3/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:37.000732 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90aa08-a679-41a2-a044-67073816c2b8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:37.001018 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90aa08-a679-41a2-a044-67073816c2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:37.001294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90aa08-a679-41a2-a044-67073816c2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:37.031341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-be90aa08-a679-41a2-a044-67073816c2b8 None None] MFA Rules not processed for user `31897d510cc8477392e465ed4e6e64b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:37.032601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-be90aa08-a679-41a2-a044-67073816c2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:37.039431 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ff75-182e-4d57-9af8-a10d9d43dccc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:37.091980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc6f56-4d59-46e6-a00f-d3b6b1e55234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:37.092628 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6f56-4d59-46e6-a00f-d3b6b1e55234 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:37.092908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6f56-4d59-46e6-a00f-d3b6b1e55234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:37.093180 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6f56-4d59-46e6-a00f-d3b6b1e55234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:37.117259 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1338/2678] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:37.129336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90aa08-a679-41a2-a044-67073816c2b8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:37.130716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-be90aa08-a679-41a2-a044-67073816c2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:37.143688 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90aa08-a679-41a2-a044-67073816c2b8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:37.147814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fd619-4090-4a5e-9e80-d1458051a60a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:37.148436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fd619-4090-4a5e-9e80-d1458051a60a service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:37.148718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fd619-4090-4a5e-9e80-d1458051a60a service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:37.148996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fd619-4090-4a5e-9e80-d1458051a60a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:37.157198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc6f56-4d59-46e6-a00f-d3b6b1e55234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:37.158768 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc6f56-4d59-46e6-a00f-d3b6b1e55234 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:37.159036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fd619-4090-4a5e-9e80-d1458051a60a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:37.160547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fd619-4090-4a5e-9e80-d1458051a60a service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:37.169747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1341/2679] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:48:37.170053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1339/2680] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:48:37.273662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc6f56-4d59-46e6-a00f-d3b6b1e55234 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:37.288631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc6f56-4d59-46e6-a00f-d3b6b1e55234 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:37.292841 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88cc66-7b19-4ac8-95e6-69a3aaff415a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:37.293304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fd619-4090-4a5e-9e80-d1458051a60a service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:37.293498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88cc66-7b19-4ac8-95e6-69a3aaff415a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:37.293809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88cc66-7b19-4ac8-95e6-69a3aaff415a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:37.294192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88cc66-7b19-4ac8-95e6-69a3aaff415a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:37.305050 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fd619-4090-4a5e-9e80-d1458051a60a service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:37.309506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed1ddc-7e2f-4d7f-85e6-0ed140fa5eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:37.310141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1ddc-7e2f-4d7f-85e6-0ed140fa5eaa service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:37.310551 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1ddc-7e2f-4d7f-85e6-0ed140fa5eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:37.311330 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1ddc-7e2f-4d7f-85e6-0ed140fa5eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:37.364017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88cc66-7b19-4ac8-95e6-69a3aaff415a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:37.365568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88cc66-7b19-4ac8-95e6-69a3aaff415a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:37.375831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1342/2681] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:37.380449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed1ddc-7e2f-4d7f-85e6-0ed140fa5eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:37.381899 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed1ddc-7e2f-4d7f-85e6-0ed140fa5eaa service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:37.392150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1340/2682] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:48:37.681769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88cc66-7b19-4ac8-95e6-69a3aaff415a service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:37.694312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:37.745907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88cc66-7b19-4ac8-95e6-69a3aaff415a service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:37.750608 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:37.751254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:37.751568 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:37.751848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] PATH_INFO: `/v3/users/9dee4226043343bc8b93e4c836bb5841` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:37.753039 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dee4226043343bc8b93e4c836bb5841)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:37.754992 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:37.802330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dee4226043343bc8b93e4c836bb5841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:37.810231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dee4226043343bc8b93e4c836bb5841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:37.817330 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dee4226043343bc8b93e4c836bb5841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:37.817953 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dee4226043343bc8b93e4c836bb5841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:37.830682 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dee4226043343bc8b93e4c836bb5841'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:37.837641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1343/2683] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:37 2022] DELETE /identity/v3/users/9dee4226043343bc8b93e4c836bb5841 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:37.842761 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31793-9f5f-44fd-a04e-097a60e787e3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:37.843244 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31793-9f5f-44fd-a04e-097a60e787e3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:37.843343 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31793-9f5f-44fd-a04e-097a60e787e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:37.864738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4ce31793-9f5f-44fd-a04e-097a60e787e3 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:37.866435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4ce31793-9f5f-44fd-a04e-097a60e787e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:37.918571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:37.929257 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1341/2684] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:37.939315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:37.940810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:38.001385 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c477ee-4312-48cf-9f21-2bc39eb110f3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:38.005161 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c455b5-3348-4fa5-8eb4-70069090a350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:38.005780 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c455b5-3348-4fa5-8eb4-70069090a350 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:38.006058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c455b5-3348-4fa5-8eb4-70069090a350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:38.006329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c455b5-3348-4fa5-8eb4-70069090a350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:38.015939 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c455b5-3348-4fa5-8eb4-70069090a350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:38.017359 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c455b5-3348-4fa5-8eb4-70069090a350 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:38.026928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1344/2685] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:38.297863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31793-9f5f-44fd-a04e-097a60e787e3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:38.299440 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4ce31793-9f5f-44fd-a04e-097a60e787e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:38.323171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31793-9f5f-44fd-a04e-097a60e787e3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:38.327837 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:38.328487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:38.328767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:38.329045 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] PATH_INFO: `/v3/projects/07a098db6dd44e46a4bde772c00be747` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:38.330197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a098db6dd44e46a4bde772c00be747)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:38.332402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:38.379332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a098db6dd44e46a4bde772c00be747', 'request_id': 'req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.385621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a098db6dd44e46a4bde772c00be747', 'request_id': 'req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.391851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a098db6dd44e46a4bde772c00be747', 'request_id': 'req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.404667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] The token cache is being invalidate because project 07a098db6dd44e46a4bde772c00be747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:38.405446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.406062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.407641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1342/2686] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:38 2022] DELETE /identity/v3/projects/07a098db6dd44e46a4bde772c00be747 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:38.412017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c455b5-3348-4fa5-8eb4-70069090a350 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:38.421484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c455b5-3348-4fa5-8eb4-70069090a350 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:38.450007 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:38.479660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:38.480311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:38.480597 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:38.480878 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] PATH_INFO: `/v3/users/31897d510cc8477392e465ed4e6e64b3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:38.482054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=31897d510cc8477392e465ed4e6e64b3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:38.484020 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:38.530968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31897d510cc8477392e465ed4e6e64b3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.540741 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31897d510cc8477392e465ed4e6e64b3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.548965 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31897d510cc8477392e465ed4e6e64b3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.549656 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31897d510cc8477392e465ed4e6e64b3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.562592 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b552c7c-cdf0-4426-867d-2efb3a8837ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31897d510cc8477392e465ed4e6e64b3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:38.569514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1345/2687] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:38 2022] DELETE /identity/v3/users/31897d510cc8477392e465ed4e6e64b3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:38.880707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:38.883399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:38.901692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8e42a-c8a2-4fbc-a15f-d21dca434b6d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:38.978550 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:38.979235 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:38.979554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:38.979832 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] PATH_INFO: `/v3/projects/e40a29d3b4a543de8ce1bcf722ffff09` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:38.981014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40a29d3b4a543de8ce1bcf722ffff09)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:38.982986 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:39.029748 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40a29d3b4a543de8ce1bcf722ffff09', 'request_id': 'req-a4bc9d58-421a-4825-ac69-4d842489c5d6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:39.035903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40a29d3b4a543de8ce1bcf722ffff09', 'request_id': 'req-a4bc9d58-421a-4825-ac69-4d842489c5d6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:39.041497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40a29d3b4a543de8ce1bcf722ffff09', 'request_id': 'req-a4bc9d58-421a-4825-ac69-4d842489c5d6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:39.054206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] The token cache is being invalidate because project e40a29d3b4a543de8ce1bcf722ffff09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:39.054499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:39.055121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a4bc9d58-421a-4825-ac69-4d842489c5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:39.056912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1343/2688] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:38 2022] DELETE /identity/v3/projects/e40a29d3b4a543de8ce1bcf722ffff09 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:39.062315 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbaca-154e-4821-a212-ebfd52186ce6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.062823 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbaca-154e-4821-a212-ebfd52186ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.062921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbaca-154e-4821-a212-ebfd52186ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.093066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-44ebbaca-154e-4821-a212-ebfd52186ce6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:39.096579 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-44ebbaca-154e-4821-a212-ebfd52186ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:39.158347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1346/2689] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:39.166099 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547571-f1c8-4c7c-9aed-d5e961343e50 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.166392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547571-f1c8-4c7c-9aed-d5e961343e50 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.166677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547571-f1c8-4c7c-9aed-d5e961343e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.188062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7b547571-f1c8-4c7c-9aed-d5e961343e50 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:39.189287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7b547571-f1c8-4c7c-9aed-d5e961343e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:39.197353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1344/2690] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:39.201796 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebbaca-154e-4821-a212-ebfd52186ce6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:39.212126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebbaca-154e-4821-a212-ebfd52186ce6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:39.216754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:39.217439 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.217717 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.217985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.218705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:39.219006 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:39.220641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:39.236850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1347/2691] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:48:39.238340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b547571-f1c8-4c7c-9aed-d5e961343e50 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:39.244084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:39.248299 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b547571-f1c8-4c7c-9aed-d5e961343e50 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:39.255808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2124e-bb51-4a1a-a105-3befd594a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:39.256673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2124e-bb51-4a1a-a105-3befd594a8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.257192 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2124e-bb51-4a1a-a105-3befd594a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.257526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2124e-bb51-4a1a-a105-3befd594a8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.258460 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2124e-bb51-4a1a-a105-3befd594a8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:39.260414 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2124e-bb51-4a1a-a105-3befd594a8bb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:39.294597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1345/2692] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:39 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:39.299333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:39.309979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59896d5f-90da-434f-a106-fd39eccc1e6c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:39.347512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:39.367540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c35c6-acfd-490a-917d-aa8f1e14ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:39.368164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c35c6-acfd-490a-917d-aa8f1e14ff2c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.368464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c35c6-acfd-490a-917d-aa8f1e14ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.368721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c35c6-acfd-490a-917d-aa8f1e14ff2c admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.369417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c35c6-acfd-490a-917d-aa8f1e14ff2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:39.371328 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c35c6-acfd-490a-917d-aa8f1e14ff2c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:39.394367 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1348/2693] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:39 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:39.398511 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2124e-bb51-4a1a-a105-3befd594a8bb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:39.408873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2124e-bb51-4a1a-a105-3befd594a8bb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:39.414608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85bf5c-0f30-4c12-ba6c-7a126628efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:39.415225 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85bf5c-0f30-4c12-ba6c-7a126628efdc admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.415547 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85bf5c-0f30-4c12-ba6c-7a126628efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.415824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85bf5c-0f30-4c12-ba6c-7a126628efdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.416516 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85bf5c-0f30-4c12-ba6c-7a126628efdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:39.418160 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85bf5c-0f30-4c12-ba6c-7a126628efdc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:39.429458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1346/2694] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:39.433697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c35c6-acfd-490a-917d-aa8f1e14ff2c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:39.444317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c35c6-acfd-490a-917d-aa8f1e14ff2c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:39.448991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a785b0-5329-4ef2-b0bc-b52e022a25cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:39.449603 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a785b0-5329-4ef2-b0bc-b52e022a25cd admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.449876 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a785b0-5329-4ef2-b0bc-b52e022a25cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.450167 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a785b0-5329-4ef2-b0bc-b52e022a25cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.450836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a785b0-5329-4ef2-b0bc-b52e022a25cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:39.452473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a785b0-5329-4ef2-b0bc-b52e022a25cd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:39.462615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1349/2695] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:39.466852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85bf5c-0f30-4c12-ba6c-7a126628efdc admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:39.477162 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85bf5c-0f30-4c12-ba6c-7a126628efdc admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:39.482261 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:39.483636 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.483981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.484419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] PATH_INFO: `/v3/projects/874132ef18844bd28a1e214faf546ec5/users/5aaed1485ca140c78c30f74a23cd4b65/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.500943 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874132ef18844bd28a1e214faf546ec5, user_id=5aaed1485ca140c78c30f74a23cd4b65, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:39.503656 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:39.517983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1347/2696] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:39 2022] PUT /identity/v3/projects/874132ef18844bd28a1e214faf546ec5/users/5aaed1485ca140c78c30f74a23cd4b65/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:39.523113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d448c-3ca2-4527-ae77-43e8f7c08c6e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.523496 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d448c-3ca2-4527-ae77-43e8f7c08c6e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.523872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d448c-3ca2-4527-ae77-43e8f7c08c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.543211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-535d448c-3ca2-4527-ae77-43e8f7c08c6e None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:39.544460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-535d448c-3ca2-4527-ae77-43e8f7c08c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:39.604251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1350/2697] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:39.614573 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:39.616277 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:39.673264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8d6d2-d4f3-4fe7-b5d9-18df6c3e45c5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:39.677275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321864c-a6bf-44da-bff3-8e2ef8fb656d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:39.677733 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321864c-a6bf-44da-bff3-8e2ef8fb656d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:39.678013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321864c-a6bf-44da-bff3-8e2ef8fb656d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:39.678285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321864c-a6bf-44da-bff3-8e2ef8fb656d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:39.687988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321864c-a6bf-44da-bff3-8e2ef8fb656d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:39.689412 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321864c-a6bf-44da-bff3-8e2ef8fb656d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:39.698818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1348/2698] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:40.407292 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fb630-ecb5-41a5-9a71-986fa7c62623 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:40.407947 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fb630-ecb5-41a5-9a71-986fa7c62623 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:40.408534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fb630-ecb5-41a5-9a71-986fa7c62623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:40.444452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-257fb630-ecb5-41a5-9a71-986fa7c62623 None None] MFA Rules not processed for user `5aaed1485ca140c78c30f74a23cd4b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:40.446308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-257fb630-ecb5-41a5-9a71-986fa7c62623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:40.539520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1351/2699] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:40.544645 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321864c-a6bf-44da-bff3-8e2ef8fb656d service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:40.571123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321864c-a6bf-44da-bff3-8e2ef8fb656d service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:40.577917 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ed99a-3a28-4d72-adf9-02da7ff4d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:40.578585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ed99a-3a28-4d72-adf9-02da7ff4d2de admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:40.578875 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ed99a-3a28-4d72-adf9-02da7ff4d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:40.579979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ed99a-3a28-4d72-adf9-02da7ff4d2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:40.579979 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ed99a-3a28-4d72-adf9-02da7ff4d2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:40.582722 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ed99a-3a28-4d72-adf9-02da7ff4d2de admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:40.616880 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1349/2700] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:40 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:40.621216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fb630-ecb5-41a5-9a71-986fa7c62623 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:40.634132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fb630-ecb5-41a5-9a71-986fa7c62623 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:40.691575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:40.697115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531f8f8-73c5-487b-b7bf-0438437b2c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:40.697742 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f8f8-73c5-487b-b7bf-0438437b2c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:40.698026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f8f8-73c5-487b-b7bf-0438437b2c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:40.698302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f8f8-73c5-487b-b7bf-0438437b2c47 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:40.698983 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531f8f8-73c5-487b-b7bf-0438437b2c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:40.700926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531f8f8-73c5-487b-b7bf-0438437b2c47 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:40.726159 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1352/2701] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:40 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:40.728245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ed99a-3a28-4d72-adf9-02da7ff4d2de admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:40.741430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ed99a-3a28-4d72-adf9-02da7ff4d2de admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:40.747695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a535c-865b-40bd-a7fd-a7634a382e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:40.748984 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a535c-865b-40bd-a7fd-a7634a382e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:40.749328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a535c-865b-40bd-a7fd-a7634a382e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:40.749662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a535c-865b-40bd-a7fd-a7634a382e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:40.750469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a535c-865b-40bd-a7fd-a7634a382e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:40.752474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a535c-865b-40bd-a7fd-a7634a382e49 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:40.771928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1350/2702] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:40.776564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531f8f8-73c5-487b-b7bf-0438437b2c47 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:40.790316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531f8f8-73c5-487b-b7bf-0438437b2c47 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:40.796665 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cb578-3205-49b7-87be-d92a41479f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:40.797344 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cb578-3205-49b7-87be-d92a41479f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:40.797630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cb578-3205-49b7-87be-d92a41479f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:40.797910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cb578-3205-49b7-87be-d92a41479f74 admin admin] PATH_INFO: `/v3/projects/e8d56f15083747c5a443e6fcaaef87f4/users/5b8fef7d95a94c14b913d28eda670b28/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:40.815998 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cb578-3205-49b7-87be-d92a41479f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d56f15083747c5a443e6fcaaef87f4, user_id=5b8fef7d95a94c14b913d28eda670b28, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:40.818700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cb578-3205-49b7-87be-d92a41479f74 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:40.832994 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1353/2703] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:40 2022] PUT /identity/v3/projects/e8d56f15083747c5a443e6fcaaef87f4/users/5b8fef7d95a94c14b913d28eda670b28/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:40.837046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a535c-865b-40bd-a7fd-a7634a382e49 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:40.847242 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a535c-865b-40bd-a7fd-a7634a382e49 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:40.905559 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43221-6d09-4272-8dae-f52ba7d243b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:40.906180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43221-6d09-4272-8dae-f52ba7d243b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:40.906462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43221-6d09-4272-8dae-f52ba7d243b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:40.906734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43221-6d09-4272-8dae-f52ba7d243b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:40.907446 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43221-6d09-4272-8dae-f52ba7d243b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:40.909043 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43221-6d09-4272-8dae-f52ba7d243b3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:40.919255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1351/2704] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:40.924695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cb578-3205-49b7-87be-d92a41479f74 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:40.934826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cb578-3205-49b7-87be-d92a41479f74 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:40.940140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bd560-4297-4853-acbf-9c4a8ea6f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:40.940800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd560-4297-4853-acbf-9c4a8ea6f338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:40.941080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd560-4297-4853-acbf-9c4a8ea6f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:40.941363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd560-4297-4853-acbf-9c4a8ea6f338 admin admin] PATH_INFO: `/v3/projects/e8d56f15083747c5a443e6fcaaef87f4/users/5b8fef7d95a94c14b913d28eda670b28/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:40.943310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd560-4297-4853-acbf-9c4a8ea6f338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d56f15083747c5a443e6fcaaef87f4, user_id=5b8fef7d95a94c14b913d28eda670b28, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:40.945950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd560-4297-4853-acbf-9c4a8ea6f338 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:40.956034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1354/2705] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:40 2022] PUT /identity/v3/projects/e8d56f15083747c5a443e6fcaaef87f4/users/5b8fef7d95a94c14b913d28eda670b28/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:41.589863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ea6a9-6ffa-4b12-bd92-e9ef36b1ef5e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:41.590364 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ea6a9-6ffa-4b12-bd92-e9ef36b1ef5e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:41.590476 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ea6a9-6ffa-4b12-bd92-e9ef36b1ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:41.616234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:41.619444 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-249ea6a9-6ffa-4b12-bd92-e9ef36b1ef5e None None] MFA Rules not processed for user `5b8fef7d95a94c14b913d28eda670b28`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:41.621405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-249ea6a9-6ffa-4b12-bd92-e9ef36b1ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:41.692908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1352/2706] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:41.703960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755a80-c653-45d7-bab9-d2f3b32c0537 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:41.704507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755a80-c653-45d7-bab9-d2f3b32c0537 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:41.704507 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755a80-c653-45d7-bab9-d2f3b32c0537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:41.724437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-62755a80-c653-45d7-bab9-d2f3b32c0537 None None] MFA Rules not processed for user `5aaed1485ca140c78c30f74a23cd4b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:41.725658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-62755a80-c653-45d7-bab9-d2f3b32c0537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:41.786216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1355/2707] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:41.800239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ea6a9-6ffa-4b12-bd92-e9ef36b1ef5e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:41.801860 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-249ea6a9-6ffa-4b12-bd92-e9ef36b1ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:41.886521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ea6a9-6ffa-4b12-bd92-e9ef36b1ef5e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:41.892950 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:41.893572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:41.893852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:41.894127 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:41.903454 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:41.905386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:41.915408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1353/2708] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:48:42.161493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755a80-c653-45d7-bab9-d2f3b32c0537 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:42.218107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755a80-c653-45d7-bab9-d2f3b32c0537 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:42.221836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:42.222530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:42.223150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:42.223150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:42.224896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:42.235896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:42.237379 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:42.246150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1356/2709] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:42.584077 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:42.585533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:42.662006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7542-1180-4660-925b-00c96b2f3e60 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:42.667116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4469084-e9b4-4c7b-8dc8-2b12166d8ab3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:42.667804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469084-e9b4-4c7b-8dc8-2b12166d8ab3 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:42.668116 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469084-e9b4-4c7b-8dc8-2b12166d8ab3 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:42.668396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469084-e9b4-4c7b-8dc8-2b12166d8ab3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:42.670736 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a4469084-e9b4-4c7b-8dc8-2b12166d8ab3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:42.683273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4469084-e9b4-4c7b-8dc8-2b12166d8ab3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:42.684895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4469084-e9b4-4c7b-8dc8-2b12166d8ab3 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:42.695741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1354/2710] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:44.681570 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:44.683056 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:44.735750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:44.757670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27eaf-3a9c-4663-a5db-b5b11fad35cd service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:44.762441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:44.763115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:44.763427 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:44.763710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] PATH_INFO: `/v3/users/a274ac14dae7441b9d076e9ce4ce8cfe` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:44.765192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a274ac14dae7441b9d076e9ce4ce8cfe)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:44.767493 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:44.828744 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a274ac14dae7441b9d076e9ce4ce8cfe'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:44.837927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a274ac14dae7441b9d076e9ce4ce8cfe'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:44.848950 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a274ac14dae7441b9d076e9ce4ce8cfe'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:44.849739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a274ac14dae7441b9d076e9ce4ce8cfe'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:44.867316 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a274ac14dae7441b9d076e9ce4ce8cfe'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:44.875057 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1357/2711] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:44 2022] DELETE /identity/v3/users/a274ac14dae7441b9d076e9ce4ce8cfe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:44.879679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f814-1772-4009-866a-5f6691300f19 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:44.880188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f814-1772-4009-866a-5f6691300f19 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:44.880359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f814-1772-4009-866a-5f6691300f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:44.901048 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-93b0f814-1772-4009-866a-5f6691300f19 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:44.902452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93b0f814-1772-4009-866a-5f6691300f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:44.913285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:44.977716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1355/2712] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:44.987286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:44.988779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:45.054416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5881cbc-cf0e-477f-93ee-51aea2a39a8e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:45.058516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:45.059236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:45.059636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:45.060013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:45.071869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:45.073700 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:45.087616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1358/2713] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:45.297743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f814-1772-4009-866a-5f6691300f19 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:45.299157 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93b0f814-1772-4009-866a-5f6691300f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:45.388280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f814-1772-4009-866a-5f6691300f19 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:45.394046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:45.394958 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:45.395245 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:45.395710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:45.397583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:45.411357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:45.413006 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:45.425405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1356/2714] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:45.541191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:45.542872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:45.558536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1601f-29e7-4bdb-9459-ccf747f7e922 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:45.563886 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:45.564669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:45.565028 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:45.565387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] PATH_INFO: `/v3/projects/678d10ba1a394bf9bc31972954ce8e82` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:45.566842 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=678d10ba1a394bf9bc31972954ce8e82)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:45.568935 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:45.625302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678d10ba1a394bf9bc31972954ce8e82', 'request_id': 'req-48f354ec-2fd5-4d4d-b551-48d50a80e458'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.634718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678d10ba1a394bf9bc31972954ce8e82', 'request_id': 'req-48f354ec-2fd5-4d4d-b551-48d50a80e458'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.641211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678d10ba1a394bf9bc31972954ce8e82', 'request_id': 'req-48f354ec-2fd5-4d4d-b551-48d50a80e458'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.642655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:45.657241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] The token cache is being invalidate because project 678d10ba1a394bf9bc31972954ce8e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:45.657546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.658208 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.659897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1359/2715] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:45 2022] DELETE /identity/v3/projects/678d10ba1a394bf9bc31972954ce8e82 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:45.664377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:45.675542 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078c17-5c62-46a3-8901-7398a0575bfc service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:45.734200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:45.734868 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:45.735146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:45.735448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] PATH_INFO: `/v3/users/50f494a74c304e50becbdb1617e4bdb2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:45.736671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f494a74c304e50becbdb1617e4bdb2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:45.738709 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:45.782651 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:45.788989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f494a74c304e50becbdb1617e4bdb2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.800215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f494a74c304e50becbdb1617e4bdb2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.801117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f494a74c304e50becbdb1617e4bdb2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.813915 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f494a74c304e50becbdb1617e4bdb2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.814611 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7df632b6-77e3-47d3-abee-3c30ab4852c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f494a74c304e50becbdb1617e4bdb2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:45.829371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1357/2716] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:45 2022] DELETE /identity/v3/users/50f494a74c304e50becbdb1617e4bdb2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:46.196584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:46.198050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:46.212303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f354ec-2fd5-4d4d-b551-48d50a80e458 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:46.272164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:46.272821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.273104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.273378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] PATH_INFO: `/v3/projects/9b67deb9baf44e43811a5370b545d6bf` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.274550 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b67deb9baf44e43811a5370b545d6bf)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:46.276498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:46.325270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b67deb9baf44e43811a5370b545d6bf', 'request_id': 'req-275c966f-20db-45c6-bdf4-e552618aa8f8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:46.333027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b67deb9baf44e43811a5370b545d6bf', 'request_id': 'req-275c966f-20db-45c6-bdf4-e552618aa8f8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:46.338606 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b67deb9baf44e43811a5370b545d6bf', 'request_id': 'req-275c966f-20db-45c6-bdf4-e552618aa8f8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:46.350955 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] The token cache is being invalidate because project 9b67deb9baf44e43811a5370b545d6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:46.351236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:46.351928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-275c966f-20db-45c6-bdf4-e552618aa8f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:46.353446 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1360/2717] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:46 2022] DELETE /identity/v3/projects/9b67deb9baf44e43811a5370b545d6bf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:46.358993 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31db03-9a3c-4f9e-a130-7a2fefba4139 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.359490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31db03-9a3c-4f9e-a130-7a2fefba4139 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.359593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31db03-9a3c-4f9e-a130-7a2fefba4139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.379171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ad31db03-9a3c-4f9e-a130-7a2fefba4139 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:46.380419 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ad31db03-9a3c-4f9e-a130-7a2fefba4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:46.440399 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1358/2718] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:46.449554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3674bf-0177-4484-abbf-f38af57c671b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.449922 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3674bf-0177-4484-abbf-f38af57c671b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.450296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3674bf-0177-4484-abbf-f38af57c671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.470489 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ff3674bf-0177-4484-abbf-f38af57c671b None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:46.471747 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ff3674bf-0177-4484-abbf-f38af57c671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:46.479911 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1361/2719] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:46.484791 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31db03-9a3c-4f9e-a130-7a2fefba4139 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:46.494941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31db03-9a3c-4f9e-a130-7a2fefba4139 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:46.499567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:46.500181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.500462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.500737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.501429 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:46.501734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:46.503339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:46.515333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1359/2720] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:48:46.519821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3674bf-0177-4484-abbf-f38af57c671b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:46.529045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3674bf-0177-4484-abbf-f38af57c671b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:46.534221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec9531-6599-405d-94d6-498b60d11aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:46.534848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9531-6599-405d-94d6-498b60d11aef admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.535111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9531-6599-405d-94d6-498b60d11aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.535402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9531-6599-405d-94d6-498b60d11aef admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.536259 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec9531-6599-405d-94d6-498b60d11aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:46.538151 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec9531-6599-405d-94d6-498b60d11aef admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:46.566600 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1362/2721] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:46 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:46.570653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:46.580804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e020d86-7aab-413a-b789-c0928120ab9a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:46.639191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0af14-7bc1-43ab-9ac9-611dc24ff826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:46.639822 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0af14-7bc1-43ab-9ac9-611dc24ff826 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.640102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0af14-7bc1-43ab-9ac9-611dc24ff826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.640372 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0af14-7bc1-43ab-9ac9-611dc24ff826 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.641042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0af14-7bc1-43ab-9ac9-611dc24ff826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:46.642944 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0af14-7bc1-43ab-9ac9-611dc24ff826 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:46.669939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1360/2722] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:46 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:46.674130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec9531-6599-405d-94d6-498b60d11aef admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:46.684901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec9531-6599-405d-94d6-498b60d11aef admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:46.690145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd32e7-bca8-4277-a73e-288b9dc06fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:46.690754 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd32e7-bca8-4277-a73e-288b9dc06fec admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.691055 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd32e7-bca8-4277-a73e-288b9dc06fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.691619 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd32e7-bca8-4277-a73e-288b9dc06fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.692109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd32e7-bca8-4277-a73e-288b9dc06fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:46.693693 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd32e7-bca8-4277-a73e-288b9dc06fec admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:46.704705 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1363/2723] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:46.708831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0af14-7bc1-43ab-9ac9-611dc24ff826 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:46.719462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0af14-7bc1-43ab-9ac9-611dc24ff826 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:46.724199 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28917cfd-f312-496f-ab87-bf009fdf0e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:46.724873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28917cfd-f312-496f-ab87-bf009fdf0e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.725160 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28917cfd-f312-496f-ab87-bf009fdf0e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.725435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28917cfd-f312-496f-ab87-bf009fdf0e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.726158 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28917cfd-f312-496f-ab87-bf009fdf0e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:46.727801 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28917cfd-f312-496f-ab87-bf009fdf0e13 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:46.738591 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1361/2724] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:48:46.742871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd32e7-bca8-4277-a73e-288b9dc06fec admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:46.753329 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd32e7-bca8-4277-a73e-288b9dc06fec admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:46.758063 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305199f-516f-4c4e-b440-cb4c9352616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:46.758725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305199f-516f-4c4e-b440-cb4c9352616f admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.759009 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305199f-516f-4c4e-b440-cb4c9352616f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.759301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305199f-516f-4c4e-b440-cb4c9352616f admin admin] PATH_INFO: `/v3/projects/4696cada5017424588b75567c2974265/users/074784f8989f499383fb38aa20bb45ea/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.775210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305199f-516f-4c4e-b440-cb4c9352616f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4696cada5017424588b75567c2974265, user_id=074784f8989f499383fb38aa20bb45ea, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:46.777884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305199f-516f-4c4e-b440-cb4c9352616f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:46.791571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1364/2725] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:46 2022] PUT /identity/v3/projects/4696cada5017424588b75567c2974265/users/074784f8989f499383fb38aa20bb45ea/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:46.802456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7947cf-5a90-4543-aa26-e192457ce353 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.802738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7947cf-5a90-4543-aa26-e192457ce353 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.803020 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7947cf-5a90-4543-aa26-e192457ce353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.831956 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5c7947cf-5a90-4543-aa26-e192457ce353 None None] MFA Rules not processed for user `074784f8989f499383fb38aa20bb45ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:46.833198 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5c7947cf-5a90-4543-aa26-e192457ce353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:46.844902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:46.901070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1362/2726] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:46.905655 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305199f-516f-4c4e-b440-cb4c9352616f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:46.934811 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:46.976872 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305199f-516f-4c4e-b440-cb4c9352616f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:46.981554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563290-fb41-429b-a04b-bf71995da43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:46.982172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563290-fb41-429b-a04b-bf71995da43e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:46.982962 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563290-fb41-429b-a04b-bf71995da43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:46.983237 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563290-fb41-429b-a04b-bf71995da43e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:46.983927 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df563290-fb41-429b-a04b-bf71995da43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:46.985813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df563290-fb41-429b-a04b-bf71995da43e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.012418 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1365/2727] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:46 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:47.016587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7947cf-5a90-4543-aa26-e192457ce353 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:47.027389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7947cf-5a90-4543-aa26-e192457ce353 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:47.083470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c20906-700c-4eca-a292-67823347b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:47.084084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c20906-700c-4eca-a292-67823347b22d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.084371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c20906-700c-4eca-a292-67823347b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.084649 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c20906-700c-4eca-a292-67823347b22d admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.085314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c20906-700c-4eca-a292-67823347b22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:47.087241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c20906-700c-4eca-a292-67823347b22d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.108219 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1363/2728] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:47 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:47.112294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563290-fb41-429b-a04b-bf71995da43e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:47.122699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563290-fb41-429b-a04b-bf71995da43e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:47.127732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4e682-9f0b-4bff-b4e7-784dcf6464be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:47.128377 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4e682-9f0b-4bff-b4e7-784dcf6464be admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.128661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4e682-9f0b-4bff-b4e7-784dcf6464be admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.128937 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4e682-9f0b-4bff-b4e7-784dcf6464be admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.129631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4e682-9f0b-4bff-b4e7-784dcf6464be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:47.131231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4e682-9f0b-4bff-b4e7-784dcf6464be admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.145880 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1366/2729] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:47.152367 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c20906-700c-4eca-a292-67823347b22d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:47.164654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c20906-700c-4eca-a292-67823347b22d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:47.169317 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ad52e-2632-4326-9a0f-bfe5d5b53717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:47.170144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ad52e-2632-4326-9a0f-bfe5d5b53717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.170601 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ad52e-2632-4326-9a0f-bfe5d5b53717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.170724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ad52e-2632-4326-9a0f-bfe5d5b53717 admin admin] PATH_INFO: `/v3/projects/1198e98b47924fbfb31fc5eaebc64bc2/users/b2d44f807b1f4831a6f9b77b762a41b5/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.186602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ad52e-2632-4326-9a0f-bfe5d5b53717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1198e98b47924fbfb31fc5eaebc64bc2, user_id=b2d44f807b1f4831a6f9b77b762a41b5, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:47.189297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ad52e-2632-4326-9a0f-bfe5d5b53717 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.202596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1364/2730] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:47 2022] PUT /identity/v3/projects/1198e98b47924fbfb31fc5eaebc64bc2/users/b2d44f807b1f4831a6f9b77b762a41b5/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:47.206908 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4e682-9f0b-4bff-b4e7-784dcf6464be admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:47.218016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4e682-9f0b-4bff-b4e7-784dcf6464be admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:47.282948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cfccd-ea3e-45eb-adb0-4dd35bb6ae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:47.283828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cfccd-ea3e-45eb-adb0-4dd35bb6ae47 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.284191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cfccd-ea3e-45eb-adb0-4dd35bb6ae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.285863 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cfccd-ea3e-45eb-adb0-4dd35bb6ae47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.286104 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cfccd-ea3e-45eb-adb0-4dd35bb6ae47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:47.287884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cfccd-ea3e-45eb-adb0-4dd35bb6ae47 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.299419 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1367/2731] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:47.303494 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ad52e-2632-4326-9a0f-bfe5d5b53717 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:47.314393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ad52e-2632-4326-9a0f-bfe5d5b53717 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:47.319402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:47.320105 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.320388 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.320665 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] PATH_INFO: `/v3/projects/1198e98b47924fbfb31fc5eaebc64bc2/users/b2d44f807b1f4831a6f9b77b762a41b5/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.322701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1198e98b47924fbfb31fc5eaebc64bc2, user_id=b2d44f807b1f4831a6f9b77b762a41b5, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:47.325377 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.336977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1365/2732] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:47 2022] PUT /identity/v3/projects/1198e98b47924fbfb31fc5eaebc64bc2/users/b2d44f807b1f4831a6f9b77b762a41b5/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:47.348390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ece005-3456-45bc-ab5f-a8388dd81316 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.348681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ece005-3456-45bc-ab5f-a8388dd81316 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.348961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ece005-3456-45bc-ab5f-a8388dd81316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.377556 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e9ece005-3456-45bc-ab5f-a8388dd81316 None None] MFA Rules not processed for user `b2d44f807b1f4831a6f9b77b762a41b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:47.378859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e9ece005-3456-45bc-ab5f-a8388dd81316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:47.446652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1368/2733] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:47.458670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:47.460469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:47.519462 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbfbd1-d52b-45fe-81ad-975779c38ca3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:47.523149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76278e7-5314-46f1-b893-815ec639d21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:47.523809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76278e7-5314-46f1-b893-815ec639d21c service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.524090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76278e7-5314-46f1-b893-815ec639d21c service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.524366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76278e7-5314-46f1-b893-815ec639d21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.534249 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76278e7-5314-46f1-b893-815ec639d21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:47.535818 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76278e7-5314-46f1-b893-815ec639d21c service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.545393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1366/2734] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:47.612158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ece005-3456-45bc-ab5f-a8388dd81316 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:47.629714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:47.675349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ece005-3456-45bc-ab5f-a8388dd81316 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:47.680405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:47.681302 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.681584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.681859 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] PATH_INFO: `/v3/users/074784f8989f499383fb38aa20bb45ea` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.683037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074784f8989f499383fb38aa20bb45ea)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:47.684991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.730470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074784f8989f499383fb38aa20bb45ea'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:47.739617 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074784f8989f499383fb38aa20bb45ea'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:47.746718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074784f8989f499383fb38aa20bb45ea'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:47.747349 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074784f8989f499383fb38aa20bb45ea'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:47.759871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074784f8989f499383fb38aa20bb45ea'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:47.766332 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1369/2735] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:47 2022] DELETE /identity/v3/users/074784f8989f499383fb38aa20bb45ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:47.771108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbda5b-32b1-4e73-a141-aa106bc0c80d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.771421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbda5b-32b1-4e73-a141-aa106bc0c80d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.771704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbda5b-32b1-4e73-a141-aa106bc0c80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.790206 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0fdbda5b-32b1-4e73-a141-aa106bc0c80d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:47.791428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0fdbda5b-32b1-4e73-a141-aa106bc0c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:47.795401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:47.852041 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1367/2736] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:47.861619 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:47.863301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:47.924069 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fa5ff-b32d-4d25-b211-564b61567454 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:47.927862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a9e40-825e-4058-b18d-bcaab3cd3088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:47.928486 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a9e40-825e-4058-b18d-bcaab3cd3088 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:47.928774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a9e40-825e-4058-b18d-bcaab3cd3088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:47.929054 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a9e40-825e-4058-b18d-bcaab3cd3088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:47.938906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a9e40-825e-4058-b18d-bcaab3cd3088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:47.940375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a9e40-825e-4058-b18d-bcaab3cd3088 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:47.949928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1370/2737] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:48.218312 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbda5b-32b1-4e73-a141-aa106bc0c80d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:48.219881 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0fdbda5b-32b1-4e73-a141-aa106bc0c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:48.236557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbda5b-32b1-4e73-a141-aa106bc0c80d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:48.242392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:48.243063 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:48.243341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:48.243734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] PATH_INFO: `/v3/projects/4696cada5017424588b75567c2974265` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:48.244808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4696cada5017424588b75567c2974265)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:48.247358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:48.295193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4696cada5017424588b75567c2974265', 'request_id': 'req-ee4a34a1-6cb1-4918-8642-c0353f5e0371'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.301589 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4696cada5017424588b75567c2974265', 'request_id': 'req-ee4a34a1-6cb1-4918-8642-c0353f5e0371'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.307354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4696cada5017424588b75567c2974265', 'request_id': 'req-ee4a34a1-6cb1-4918-8642-c0353f5e0371'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.320121 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] The token cache is being invalidate because project 4696cada5017424588b75567c2974265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:48.320416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.321059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.322587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1368/2738] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:48 2022] DELETE /identity/v3/projects/4696cada5017424588b75567c2974265 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:48.327155 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a9e40-825e-4058-b18d-bcaab3cd3088 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:48.336844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a9e40-825e-4058-b18d-bcaab3cd3088 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:48.371321 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:48.396626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:48.397219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:48.397498 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:48.397853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] PATH_INFO: `/v3/users/b2d44f807b1f4831a6f9b77b762a41b5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:48.399033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d44f807b1f4831a6f9b77b762a41b5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:48.401026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:48.457251 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d44f807b1f4831a6f9b77b762a41b5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.468752 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d44f807b1f4831a6f9b77b762a41b5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.476941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d44f807b1f4831a6f9b77b762a41b5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.477708 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d44f807b1f4831a6f9b77b762a41b5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.491930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6645f2ac-0c7e-4b8e-8b2a-5f461268d5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d44f807b1f4831a6f9b77b762a41b5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.499557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1371/2739] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:48 2022] DELETE /identity/v3/users/b2d44f807b1f4831a6f9b77b762a41b5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:48.816585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:48.818151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:48.843678 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a34a1-6cb1-4918-8642-c0353f5e0371 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:48.909489 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:48.910152 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:48.910426 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:48.910743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] PATH_INFO: `/v3/projects/1198e98b47924fbfb31fc5eaebc64bc2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:48.912524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1198e98b47924fbfb31fc5eaebc64bc2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:48.914730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:48.954445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:48.964793 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1198e98b47924fbfb31fc5eaebc64bc2', 'request_id': 'req-c9f79961-3ede-4b99-8192-5b8e97eac371'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.971009 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1198e98b47924fbfb31fc5eaebc64bc2', 'request_id': 'req-c9f79961-3ede-4b99-8192-5b8e97eac371'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.976996 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1198e98b47924fbfb31fc5eaebc64bc2', 'request_id': 'req-c9f79961-3ede-4b99-8192-5b8e97eac371'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.990436 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] The token cache is being invalidate because project 1198e98b47924fbfb31fc5eaebc64bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:48.990730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.991339 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c9f79961-3ede-4b99-8192-5b8e97eac371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:48.992862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1369/2740] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:48 2022] DELETE /identity/v3/projects/1198e98b47924fbfb31fc5eaebc64bc2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:48.997722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fbc21-c758-4f10-bd8d-b1b41a09b2af None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:48.998019 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fbc21-c758-4f10-bd8d-b1b41a09b2af None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:48.998916 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fbc21-c758-4f10-bd8d-b1b41a09b2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.018129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-095fbc21-c758-4f10-bd8d-b1b41a09b2af None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:49.019580 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-095fbc21-c758-4f10-bd8d-b1b41a09b2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:49.079699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1372/2741] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:49.088620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9ff51-0ba0-46e5-9c1e-38057581cd02 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.088912 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9ff51-0ba0-46e5-9c1e-38057581cd02 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.089187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9ff51-0ba0-46e5-9c1e-38057581cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.109169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6bc9ff51-0ba0-46e5-9c1e-38057581cd02 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:49.110365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6bc9ff51-0ba0-46e5-9c1e-38057581cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:49.118946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1370/2742] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:49.123765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fbc21-c758-4f10-bd8d-b1b41a09b2af None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.133407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fbc21-c758-4f10-bd8d-b1b41a09b2af None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.137906 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.138516 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.138891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.139169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.139901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:49.140206 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.141828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.154094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1373/2743] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:48:49.166290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9ff51-0ba0-46e5-9c1e-38057581cd02 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.179285 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9ff51-0ba0-46e5-9c1e-38057581cd02 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.187496 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd999c6e-d012-4547-a8db-fa6082854152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.188122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd999c6e-d012-4547-a8db-fa6082854152 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.188394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd999c6e-d012-4547-a8db-fa6082854152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.188662 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd999c6e-d012-4547-a8db-fa6082854152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.189324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd999c6e-d012-4547-a8db-fa6082854152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.191221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd999c6e-d012-4547-a8db-fa6082854152 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.219934 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1371/2744] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:49 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:49.224564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.234523 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460c865-6d27-4e2a-b918-cae8efff7a3b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.275949 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:49.294280 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896f66c-9b58-4015-8bf4-e7bc6a0f471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.295546 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896f66c-9b58-4015-8bf4-e7bc6a0f471a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.295844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896f66c-9b58-4015-8bf4-e7bc6a0f471a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.296120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896f66c-9b58-4015-8bf4-e7bc6a0f471a admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.296782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896f66c-9b58-4015-8bf4-e7bc6a0f471a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.298694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896f66c-9b58-4015-8bf4-e7bc6a0f471a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.321081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1374/2745] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:49 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:49.325530 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd999c6e-d012-4547-a8db-fa6082854152 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.336723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd999c6e-d012-4547-a8db-fa6082854152 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.341417 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b14ba-357b-4a65-8ce0-e78b6dc1b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.342684 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b14ba-357b-4a65-8ce0-e78b6dc1b021 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.342964 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b14ba-357b-4a65-8ce0-e78b6dc1b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.343240 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b14ba-357b-4a65-8ce0-e78b6dc1b021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.343975 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b14ba-357b-4a65-8ce0-e78b6dc1b021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.345574 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b14ba-357b-4a65-8ce0-e78b6dc1b021 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.355549 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1372/2746] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:49.360043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896f66c-9b58-4015-8bf4-e7bc6a0f471a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.370132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896f66c-9b58-4015-8bf4-e7bc6a0f471a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.374777 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4296f-6e24-498d-b9fb-16c593a2a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.375398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4296f-6e24-498d-b9fb-16c593a2a273 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.375687 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4296f-6e24-498d-b9fb-16c593a2a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.375959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4296f-6e24-498d-b9fb-16c593a2a273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.376643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4296f-6e24-498d-b9fb-16c593a2a273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.378223 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4296f-6e24-498d-b9fb-16c593a2a273 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.389753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1375/2747] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:49.394034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b14ba-357b-4a65-8ce0-e78b6dc1b021 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.405126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b14ba-357b-4a65-8ce0-e78b6dc1b021 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.409810 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59480309-9f6c-4a1b-9c8c-a1d3a23cc399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.410469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480309-9f6c-4a1b-9c8c-a1d3a23cc399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.410744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480309-9f6c-4a1b-9c8c-a1d3a23cc399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.411013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480309-9f6c-4a1b-9c8c-a1d3a23cc399 admin admin] PATH_INFO: `/v3/projects/3fd9ccd6a1454f309a49ed6f334f28c2/users/b6a4c3fb99e24a8f942724bdf1e99020/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.425552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480309-9f6c-4a1b-9c8c-a1d3a23cc399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd9ccd6a1454f309a49ed6f334f28c2, user_id=b6a4c3fb99e24a8f942724bdf1e99020, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.428227 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480309-9f6c-4a1b-9c8c-a1d3a23cc399 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.441618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1373/2748] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:49 2022] PUT /identity/v3/projects/3fd9ccd6a1454f309a49ed6f334f28c2/users/b6a4c3fb99e24a8f942724bdf1e99020/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:49.452276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8f4e-06ff-42bc-b932-b65fa85dc512 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.452571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8f4e-06ff-42bc-b932-b65fa85dc512 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.452881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8f4e-06ff-42bc-b932-b65fa85dc512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.480919 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b56e8f4e-06ff-42bc-b932-b65fa85dc512 None None] MFA Rules not processed for user `b6a4c3fb99e24a8f942724bdf1e99020`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:49.482129 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b56e8f4e-06ff-42bc-b932-b65fa85dc512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:49.545688 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1376/2749] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:49.550181 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59480309-9f6c-4a1b-9c8c-a1d3a23cc399 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.615616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59480309-9f6c-4a1b-9c8c-a1d3a23cc399 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.620393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fdf33-bfde-4a78-bb27-96e0d984a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.621017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fdf33-bfde-4a78-bb27-96e0d984a587 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.621352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fdf33-bfde-4a78-bb27-96e0d984a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.621632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fdf33-bfde-4a78-bb27-96e0d984a587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.622297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fdf33-bfde-4a78-bb27-96e0d984a587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.624353 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fdf33-bfde-4a78-bb27-96e0d984a587 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.658348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1374/2750] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:49 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:49.659538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e8f4e-06ff-42bc-b932-b65fa85dc512 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.670756 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e8f4e-06ff-42bc-b932-b65fa85dc512 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.730269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475de6d0-e133-4977-9b65-8e780db26ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.731158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475de6d0-e133-4977-9b65-8e780db26ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.731524 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475de6d0-e133-4977-9b65-8e780db26ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.731796 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475de6d0-e133-4977-9b65-8e780db26ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.732566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475de6d0-e133-4977-9b65-8e780db26ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.734540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475de6d0-e133-4977-9b65-8e780db26ff0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.756657 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1377/2751] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:49 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:49.760701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fdf33-bfde-4a78-bb27-96e0d984a587 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.771779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fdf33-bfde-4a78-bb27-96e0d984a587 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.776358 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946b41c-37d4-478b-b41c-d168a7440f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.776968 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b41c-37d4-478b-b41c-d168a7440f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.777246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b41c-37d4-478b-b41c-d168a7440f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.777517 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b41c-37d4-478b-b41c-d168a7440f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.778201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946b41c-37d4-478b-b41c-d168a7440f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.779859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946b41c-37d4-478b-b41c-d168a7440f35 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.790452 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1375/2752] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:49.794789 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475de6d0-e133-4977-9b65-8e780db26ff0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.806467 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475de6d0-e133-4977-9b65-8e780db26ff0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.812274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd46e-ab6a-4f94-832c-9d275d9429d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.813224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd46e-ab6a-4f94-832c-9d275d9429d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.813595 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd46e-ab6a-4f94-832c-9d275d9429d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.813905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd46e-ab6a-4f94-832c-9d275d9429d9 admin admin] PATH_INFO: `/v3/projects/ed57bbdc03384273bda1b6fad61e77f3/users/ae856606cd1f4ccfb4fe8b037e6194d4/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.830822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bd46e-ab6a-4f94-832c-9d275d9429d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed57bbdc03384273bda1b6fad61e77f3, user_id=ae856606cd1f4ccfb4fe8b037e6194d4, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.834596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bd46e-ab6a-4f94-832c-9d275d9429d9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.848127 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1378/2753] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:49 2022] PUT /identity/v3/projects/ed57bbdc03384273bda1b6fad61e77f3/users/ae856606cd1f4ccfb4fe8b037e6194d4/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:49.852239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946b41c-37d4-478b-b41c-d168a7440f35 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.862237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946b41c-37d4-478b-b41c-d168a7440f35 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.895386 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:49.922625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d251a-6700-43fb-a183-b0f0ebe09481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.923248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d251a-6700-43fb-a183-b0f0ebe09481 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.923568 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d251a-6700-43fb-a183-b0f0ebe09481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.923846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d251a-6700-43fb-a183-b0f0ebe09481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.924536 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d251a-6700-43fb-a183-b0f0ebe09481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.926140 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d251a-6700-43fb-a183-b0f0ebe09481 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.937113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1376/2754] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:49.941610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd46e-ab6a-4f94-832c-9d275d9429d9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:49.952468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd46e-ab6a-4f94-832c-9d275d9429d9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:49.957013 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:49.957667 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.957945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.958219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] PATH_INFO: `/v3/projects/ed57bbdc03384273bda1b6fad61e77f3/users/ae856606cd1f4ccfb4fe8b037e6194d4/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:49.960165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed57bbdc03384273bda1b6fad61e77f3, user_id=ae856606cd1f4ccfb4fe8b037e6194d4, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:49.962774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:49.973265 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1379/2755] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:49 2022] PUT /identity/v3/projects/ed57bbdc03384273bda1b6fad61e77f3/users/ae856606cd1f4ccfb4fe8b037e6194d4/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:49.983920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc585d9-d763-49da-a5c9-a53bf07cb09d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:49.984143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc585d9-d763-49da-a5c9-a53bf07cb09d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:49.984427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc585d9-d763-49da-a5c9-a53bf07cb09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:50.012606 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-cfc585d9-d763-49da-a5c9-a53bf07cb09d None None] MFA Rules not processed for user `ae856606cd1f4ccfb4fe8b037e6194d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:50.014416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cfc585d9-d763-49da-a5c9-a53bf07cb09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:50.082692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1377/2756] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:50.093831 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:50.095616 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:50.102488 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:50.156204 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f02b23-504c-43f2-9653-d69461f34e74 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:50.159837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:50.160456 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:50.160734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:50.161005 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:50.170800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:50.172255 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:50.181979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1380/2757] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:50.274106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc585d9-d763-49da-a5c9-a53bf07cb09d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:50.284180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc585d9-d763-49da-a5c9-a53bf07cb09d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:50.287774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d7024-65e9-48f9-825f-56f638852670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:50.288391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7024-65e9-48f9-825f-56f638852670 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:50.288677 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7024-65e9-48f9-825f-56f638852670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:50.288959 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7024-65e9-48f9-825f-56f638852670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:50.348070 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d7024-65e9-48f9-825f-56f638852670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:50.349519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d7024-65e9-48f9-825f-56f638852670 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:50.359286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1378/2758] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:53.203086 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:53.204885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:53.336081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d047595-05a8-43da-a9e8-6fcd1e8f77e3 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:53.342897 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b80fd-044e-4866-a63d-d7317234a8fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:53.343694 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b80fd-044e-4866-a63d-d7317234a8fd service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:53.343984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b80fd-044e-4866-a63d-d7317234a8fd service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:53.344269 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b80fd-044e-4866-a63d-d7317234a8fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:53.346303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-088b80fd-044e-4866-a63d-d7317234a8fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:53.360850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b80fd-044e-4866-a63d-d7317234a8fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:53.362443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b80fd-044e-4866-a63d-d7317234a8fd service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:53.378510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1381/2759] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:55.225727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d7024-65e9-48f9-825f-56f638852670 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:55.282236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:55.294034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d7024-65e9-48f9-825f-56f638852670 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:55.299464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:55.300108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:55.300391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:55.300667 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] PATH_INFO: `/v3/users/b6a4c3fb99e24a8f942724bdf1e99020` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:55.301846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a4c3fb99e24a8f942724bdf1e99020)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:55.303840 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:55.358164 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a4c3fb99e24a8f942724bdf1e99020'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:55.365640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a4c3fb99e24a8f942724bdf1e99020'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:55.366284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a4c3fb99e24a8f942724bdf1e99020'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:55.381287 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a4c3fb99e24a8f942724bdf1e99020'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:55.381987 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a4c3fb99e24a8f942724bdf1e99020'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:55.394727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1379/2760] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:55 2022] DELETE /identity/v3/users/b6a4c3fb99e24a8f942724bdf1e99020 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:55.399394 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf282-6f14-45b2-81e1-8591e986dd86 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:55.399853 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf282-6f14-45b2-81e1-8591e986dd86 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:55.399972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf282-6f14-45b2-81e1-8591e986dd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:55.418538 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dbedf282-6f14-45b2-81e1-8591e986dd86 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:55.420295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dbedf282-6f14-45b2-81e1-8591e986dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:55.479286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1382/2761] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:55.489790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:55.491213 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:55.551812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d178d0-503a-48ea-abd0-13c912603955 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:55.555555 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8dcce-a001-4236-8571-c433ff568b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:55.556519 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8dcce-a001-4236-8571-c433ff568b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:55.556805 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8dcce-a001-4236-8571-c433ff568b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:55.557090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8dcce-a001-4236-8571-c433ff568b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:55.569778 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8dcce-a001-4236-8571-c433ff568b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:55.571243 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8dcce-a001-4236-8571-c433ff568b16 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:55.581622 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1380/2762] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:55.976221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedf282-6f14-45b2-81e1-8591e986dd86 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:55.979044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dbedf282-6f14-45b2-81e1-8591e986dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:55.993131 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedf282-6f14-45b2-81e1-8591e986dd86 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:56.004254 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:56.004928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:56.005209 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:56.005668 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] PATH_INFO: `/v3/projects/3fd9ccd6a1454f309a49ed6f334f28c2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:56.006942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd9ccd6a1454f309a49ed6f334f28c2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:56.009399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:56.051866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:56.073135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd9ccd6a1454f309a49ed6f334f28c2', 'request_id': 'req-9854beab-b0ab-4094-8dc5-4ba38ec06be7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.085192 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd9ccd6a1454f309a49ed6f334f28c2', 'request_id': 'req-9854beab-b0ab-4094-8dc5-4ba38ec06be7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.097188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd9ccd6a1454f309a49ed6f334f28c2', 'request_id': 'req-9854beab-b0ab-4094-8dc5-4ba38ec06be7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.110788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] The token cache is being invalidate because project 3fd9ccd6a1454f309a49ed6f334f28c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:56.111184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.111826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.113740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1383/2763] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:55 2022] DELETE /identity/v3/projects/3fd9ccd6a1454f309a49ed6f334f28c2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:56.117673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8dcce-a001-4236-8571-c433ff568b16 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:56.128360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8dcce-a001-4236-8571-c433ff568b16 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:56.190084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:56.190721 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:56.191137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:56.191435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] PATH_INFO: `/v3/users/ae856606cd1f4ccfb4fe8b037e6194d4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:56.192587 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae856606cd1f4ccfb4fe8b037e6194d4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:56.194497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:56.211322 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:56.247596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae856606cd1f4ccfb4fe8b037e6194d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.255400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae856606cd1f4ccfb4fe8b037e6194d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.256013 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae856606cd1f4ccfb4fe8b037e6194d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.268644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae856606cd1f4ccfb4fe8b037e6194d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.269267 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5d795206-a900-4ab8-906f-f492fb289750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae856606cd1f4ccfb4fe8b037e6194d4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.282143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1381/2764] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:48:56 2022] DELETE /identity/v3/users/ae856606cd1f4ccfb4fe8b037e6194d4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:56.555722 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:56.557402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:56.574030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854beab-b0ab-4094-8dc5-4ba38ec06be7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:56.633619 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:56.634263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:56.634541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:56.634809 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] PATH_INFO: `/v3/projects/ed57bbdc03384273bda1b6fad61e77f3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:56.635972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed57bbdc03384273bda1b6fad61e77f3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:56.637862 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:56.688014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed57bbdc03384273bda1b6fad61e77f3', 'request_id': 'req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.695559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed57bbdc03384273bda1b6fad61e77f3', 'request_id': 'req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.701764 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed57bbdc03384273bda1b6fad61e77f3', 'request_id': 'req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.713225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] The token cache is being invalidate because project ed57bbdc03384273bda1b6fad61e77f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:48:56.713510 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.714172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b185dcbe-14f5-4ed7-84fc-fd25cc55424f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:48:56.715710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1384/2765] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:48:56 2022] DELETE /identity/v3/projects/ed57bbdc03384273bda1b6fad61e77f3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:56.720720 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31730d54-47e0-458b-855e-d6c971f3bd95 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:56.721053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31730d54-47e0-458b-855e-d6c971f3bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:56.721352 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31730d54-47e0-458b-855e-d6c971f3bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:56.742374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-31730d54-47e0-458b-855e-d6c971f3bd95 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:56.743644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-31730d54-47e0-458b-855e-d6c971f3bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:56.805643 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1382/2766] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:56.814261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7acc8-dc84-4109-912f-d8ced48ff344 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:56.814547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7acc8-dc84-4109-912f-d8ced48ff344 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:56.814975 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7acc8-dc84-4109-912f-d8ced48ff344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:56.834820 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b2b7acc8-dc84-4109-912f-d8ced48ff344 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:56.836070 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b2b7acc8-dc84-4109-912f-d8ced48ff344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:56.843928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1385/2767] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:56.848532 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31730d54-47e0-458b-855e-d6c971f3bd95 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:56.859394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31730d54-47e0-458b-855e-d6c971f3bd95 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:56.864094 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:56.864708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:56.864995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:56.865276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:56.865971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:48:56.866273 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:56.867940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:56.880324 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1383/2768] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:48:56.884676 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7acc8-dc84-4109-912f-d8ced48ff344 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:56.894238 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7acc8-dc84-4109-912f-d8ced48ff344 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:56.899346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913bdc-8f28-4d91-ad53-b3ff7329f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:56.900016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913bdc-8f28-4d91-ad53-b3ff7329f150 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:56.900298 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913bdc-8f28-4d91-ad53-b3ff7329f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:56.900573 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913bdc-8f28-4d91-ad53-b3ff7329f150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:56.901252 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913bdc-8f28-4d91-ad53-b3ff7329f150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:56.903149 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913bdc-8f28-4d91-ad53-b3ff7329f150 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:56.933634 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1386/2769] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:56 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:56.938561 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:56.948750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc6d2e-aaa9-4908-86b1-2d6d1ec2111e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.005396 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffc806-943e-4c93-aeaf-c38d9d4951e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.006024 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffc806-943e-4c93-aeaf-c38d9d4951e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.006308 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffc806-943e-4c93-aeaf-c38d9d4951e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.006583 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffc806-943e-4c93-aeaf-c38d9d4951e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.007237 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffc806-943e-4c93-aeaf-c38d9d4951e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.009202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffc806-943e-4c93-aeaf-c38d9d4951e4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.031416 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1384/2770] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:56 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:57.036121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913bdc-8f28-4d91-ad53-b3ff7329f150 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.047701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913bdc-8f28-4d91-ad53-b3ff7329f150 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.052641 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af27fc1-f62d-451e-8d69-8d25c38e2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.053253 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27fc1-f62d-451e-8d69-8d25c38e2893 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.053563 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27fc1-f62d-451e-8d69-8d25c38e2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.053836 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27fc1-f62d-451e-8d69-8d25c38e2893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.054558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af27fc1-f62d-451e-8d69-8d25c38e2893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.056659 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af27fc1-f62d-451e-8d69-8d25c38e2893 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.067590 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1387/2771] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:57.071598 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffc806-943e-4c93-aeaf-c38d9d4951e4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.081930 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffc806-943e-4c93-aeaf-c38d9d4951e4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.086710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8afc4-14b2-4fd9-9b2a-c33cc222aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.087319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8afc4-14b2-4fd9-9b2a-c33cc222aafb admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.087627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8afc4-14b2-4fd9-9b2a-c33cc222aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.087903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8afc4-14b2-4fd9-9b2a-c33cc222aafb admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.088580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8afc4-14b2-4fd9-9b2a-c33cc222aafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.090193 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8afc4-14b2-4fd9-9b2a-c33cc222aafb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.095593 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:57.102798 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1385/2772] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:57.107077 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af27fc1-f62d-451e-8d69-8d25c38e2893 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.118145 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af27fc1-f62d-451e-8d69-8d25c38e2893 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.123686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3022-54db-4c66-a224-e3e18ea8ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.124398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3022-54db-4c66-a224-e3e18ea8ae98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.124686 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3022-54db-4c66-a224-e3e18ea8ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.124964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3022-54db-4c66-a224-e3e18ea8ae98 admin admin] PATH_INFO: `/v3/projects/12254ada29bf4009a41171945623cfb5/users/fcf1f811b07c4d76aeffcea22924229d/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.127490 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:57.143761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf3022-54db-4c66-a224-e3e18ea8ae98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12254ada29bf4009a41171945623cfb5, user_id=fcf1f811b07c4d76aeffcea22924229d, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.146448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf3022-54db-4c66-a224-e3e18ea8ae98 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.160936 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1388/2773] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:57 2022] PUT /identity/v3/projects/12254ada29bf4009a41171945623cfb5/users/fcf1f811b07c4d76aeffcea22924229d/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:57.172780 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7ff1-9e35-4029-8643-9481020b2a1e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.173098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7ff1-9e35-4029-8643-9481020b2a1e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.173421 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7ff1-9e35-4029-8643-9481020b2a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.203274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-06be7ff1-9e35-4029-8643-9481020b2a1e None None] MFA Rules not processed for user `fcf1f811b07c4d76aeffcea22924229d`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:57.204734 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-06be7ff1-9e35-4029-8643-9481020b2a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:57.278658 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1386/2774] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:57.283575 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3022-54db-4c66-a224-e3e18ea8ae98 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.354661 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3022-54db-4c66-a224-e3e18ea8ae98 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.359241 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.359891 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.360170 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.360440 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.361106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.363272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.400270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1389/2775] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:57 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:57.406078 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7ff1-9e35-4029-8643-9481020b2a1e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.416246 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7ff1-9e35-4029-8643-9481020b2a1e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.486076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6e9e-34ce-41da-9e08-1e4a1385e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.486711 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6e9e-34ce-41da-9e08-1e4a1385e200 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.486991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6e9e-34ce-41da-9e08-1e4a1385e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.487263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6e9e-34ce-41da-9e08-1e4a1385e200 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.487973 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb6e9e-34ce-41da-9e08-1e4a1385e200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.489922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb6e9e-34ce-41da-9e08-1e4a1385e200 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.500358 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.502066 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:57.512812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1387/2776] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:57 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:48:57.517575 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6e9e-34ce-41da-9e08-1e4a1385e200 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.527713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6e9e-34ce-41da-9e08-1e4a1385e200 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.532769 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45234dc3-7544-4e8a-9283-77409c78cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.533509 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45234dc3-7544-4e8a-9283-77409c78cb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.533794 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45234dc3-7544-4e8a-9283-77409c78cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.534075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45234dc3-7544-4e8a-9283-77409c78cb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.534852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45234dc3-7544-4e8a-9283-77409c78cb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.536577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45234dc3-7544-4e8a-9283-77409c78cb04 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.547628 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1388/2777] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:48:57.551687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45234dc3-7544-4e8a-9283-77409c78cb04 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.562644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45234dc3-7544-4e8a-9283-77409c78cb04 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.565551 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329b049-d89e-4b5a-a14d-2c2b9d568bd6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.568144 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e8566-7b89-4c9a-8fed-22775253bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.568766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e8566-7b89-4c9a-8fed-22775253bad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.569053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e8566-7b89-4c9a-8fed-22775253bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.569230 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.569355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e8566-7b89-4c9a-8fed-22775253bad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.569869 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.570081 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e8566-7b89-4c9a-8fed-22775253bad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.570203 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.570413 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.572123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e8566-7b89-4c9a-8fed-22775253bad6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.572581 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:57.584989 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1389/2778] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:48:57.589188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e8566-7b89-4c9a-8fed-22775253bad6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.599180 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e8566-7b89-4c9a-8fed-22775253bad6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.603902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560881f-59a9-45ee-90d0-f163fe3300f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.604576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560881f-59a9-45ee-90d0-f163fe3300f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.604910 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560881f-59a9-45ee-90d0-f163fe3300f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.605126 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560881f-59a9-45ee-90d0-f163fe3300f8 admin admin] PATH_INFO: `/v3/projects/1075a04776374d68849f5828dcc9567c/users/4e3bae4630104adbb7a3431c371ba9e8/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.620687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560881f-59a9-45ee-90d0-f163fe3300f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1075a04776374d68849f5828dcc9567c, user_id=4e3bae4630104adbb7a3431c371ba9e8, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.623991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560881f-59a9-45ee-90d0-f163fe3300f8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.636990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1390/2779] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:57 2022] PUT /identity/v3/projects/1075a04776374d68849f5828dcc9567c/users/4e3bae4630104adbb7a3431c371ba9e8/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:48:57.639088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.640576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.648495 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21bd97-5df2-4f64-847b-fe8a3577cfc9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.648781 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21bd97-5df2-4f64-847b-fe8a3577cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.649062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21bd97-5df2-4f64-847b-fe8a3577cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.650761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1390/2780] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:48:57.678297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0f21bd97-5df2-4f64-847b-fe8a3577cfc9 None None] MFA Rules not processed for user `4e3bae4630104adbb7a3431c371ba9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:57.679674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0f21bd97-5df2-4f64-847b-fe8a3577cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:57.706521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:57.753983 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1391/2781] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:48:57.758630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.768896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aa229-a238-49d7-bc20-117890ecf14c service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.781318 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:57.830084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ba7e-e0ec-44cf-a7b6-7b2a975ede11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.830723 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ba7e-e0ec-44cf-a7b6-7b2a975ede11 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.830985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ba7e-e0ec-44cf-a7b6-7b2a975ede11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.831347 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ba7e-e0ec-44cf-a7b6-7b2a975ede11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.832320 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5ba7e-e0ec-44cf-a7b6-7b2a975ede11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.834374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5ba7e-e0ec-44cf-a7b6-7b2a975ede11 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.866417 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1391/2782] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:48:57 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:57.867617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21bd97-5df2-4f64-847b-fe8a3577cfc9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.879785 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21bd97-5df2-4f64-847b-fe8a3577cfc9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.938691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226cce8-6a6d-407b-8c2d-1d3b1f8170fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.939321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226cce8-6a6d-407b-8c2d-1d3b1f8170fe admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.939639 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226cce8-6a6d-407b-8c2d-1d3b1f8170fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.939946 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226cce8-6a6d-407b-8c2d-1d3b1f8170fe admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.940620 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226cce8-6a6d-407b-8c2d-1d3b1f8170fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.942704 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226cce8-6a6d-407b-8c2d-1d3b1f8170fe admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:57.967696 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1392/2783] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:48:57 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:48:57.971810 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ba7e-e0ec-44cf-a7b6-7b2a975ede11 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:57.985506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ba7e-e0ec-44cf-a7b6-7b2a975ede11 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:57.990858 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6e35-f456-40ab-b1fa-a71e8f35b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:57.991545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6e35-f456-40ab-b1fa-a71e8f35b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:57.991827 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6e35-f456-40ab-b1fa-a71e8f35b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:57.992337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6e35-f456-40ab-b1fa-a71e8f35b8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:57.993052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba6e35-f456-40ab-b1fa-a71e8f35b8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:57.994647 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba6e35-f456-40ab-b1fa-a71e8f35b8cf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:58.008765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1392/2784] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:58.009877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226cce8-6a6d-407b-8c2d-1d3b1f8170fe admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:58.020391 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226cce8-6a6d-407b-8c2d-1d3b1f8170fe admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:58.025062 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01643d-ca83-40d9-bb9d-4b382122716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:58.025727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01643d-ca83-40d9-bb9d-4b382122716b admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:58.026005 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01643d-ca83-40d9-bb9d-4b382122716b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:58.026328 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01643d-ca83-40d9-bb9d-4b382122716b admin admin] PATH_INFO: `/v3/projects/1676bc0a69fb43d7bb9ee634506a79f4/users/7ae65ad32199424aadec25a7ea68a8a3/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:58.042151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01643d-ca83-40d9-bb9d-4b382122716b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1676bc0a69fb43d7bb9ee634506a79f4, user_id=7ae65ad32199424aadec25a7ea68a8a3, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:58.045586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01643d-ca83-40d9-bb9d-4b382122716b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:58.059809 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1393/2785] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:58 2022] PUT /identity/v3/projects/1676bc0a69fb43d7bb9ee634506a79f4/users/7ae65ad32199424aadec25a7ea68a8a3/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:58.063889 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6e35-f456-40ab-b1fa-a71e8f35b8cf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:58.073943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6e35-f456-40ab-b1fa-a71e8f35b8cf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:58.132699 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7678-2a2d-4889-8790-4577f40e287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:58.133403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7678-2a2d-4889-8790-4577f40e287b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:58.133690 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7678-2a2d-4889-8790-4577f40e287b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:58.133964 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7678-2a2d-4889-8790-4577f40e287b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:58.134665 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac7678-2a2d-4889-8790-4577f40e287b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:58.136295 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac7678-2a2d-4889-8790-4577f40e287b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:58.147031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1393/2786] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:48:58.151673 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01643d-ca83-40d9-bb9d-4b382122716b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:58.162469 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01643d-ca83-40d9-bb9d-4b382122716b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:58.167209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:58.167981 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:58.168333 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:58.168679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] PATH_INFO: `/v3/projects/1676bc0a69fb43d7bb9ee634506a79f4/users/7ae65ad32199424aadec25a7ea68a8a3/roles/7a7079c0864e4bb7acaa71238097426e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:58.171468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1676bc0a69fb43d7bb9ee634506a79f4, user_id=7ae65ad32199424aadec25a7ea68a8a3, role_id=7a7079c0864e4bb7acaa71238097426e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:58.174276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:58.185351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1394/2787] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:48:58 2022] PUT /identity/v3/projects/1676bc0a69fb43d7bb9ee634506a79f4/users/7ae65ad32199424aadec25a7ea68a8a3/roles/7a7079c0864e4bb7acaa71238097426e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:48:58.195784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c56df-b3ef-41ba-8b88-537cff95b18b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:58.196082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c56df-b3ef-41ba-8b88-537cff95b18b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:58.196361 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c56df-b3ef-41ba-8b88-537cff95b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:58.227212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-410c56df-b3ef-41ba-8b88-537cff95b18b None None] MFA Rules not processed for user `7ae65ad32199424aadec25a7ea68a8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:58.228471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-410c56df-b3ef-41ba-8b88-537cff95b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:58.301773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1394/2788] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:48:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:58.313354 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:58.315814 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:58.381936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12f330-0c40-428b-ac80-bc448cb11294 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:58.385782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4387-021a-4e60-a1e3-6d1311f1bdae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:58.386525 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4387-021a-4e60-a1e3-6d1311f1bdae service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:58.386865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4387-021a-4e60-a1e3-6d1311f1bdae service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:58.387203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4387-021a-4e60-a1e3-6d1311f1bdae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:58.417954 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:58.451848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f4387-021a-4e60-a1e3-6d1311f1bdae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:58.453463 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f4387-021a-4e60-a1e3-6d1311f1bdae service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:58.463274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1395/2789] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:48:59.977448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c56df-b3ef-41ba-8b88-537cff95b18b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:59.987433 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c56df-b3ef-41ba-8b88-537cff95b18b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:59.992437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:59.993050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:59.993357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:59.993633 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:00.010825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:00.068034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:00.069388 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:00.078948 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1395/2790] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:48:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:00.707464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4387-021a-4e60-a1e3-6d1311f1bdae service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:00.717448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4387-021a-4e60-a1e3-6d1311f1bdae service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:00.722531 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d56b-b6cc-4e6c-91ab-85919634c19f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:00.722913 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d56b-b6cc-4e6c-91ab-85919634c19f service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:00.723418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d56b-b6cc-4e6c-91ab-85919634c19f service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:00.723815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d56b-b6cc-4e6c-91ab-85919634c19f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:00.740284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41d56b-b6cc-4e6c-91ab-85919634c19f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:00.742461 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41d56b-b6cc-4e6c-91ab-85919634c19f service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:00.765090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1396/2791] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:00.768286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:00.770559 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:01.023191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e190005-0fd9-4684-a7c2-3b6842c11be7 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:01.032040 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891658e9-03f8-4f64-93a4-36535d6dd494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:01.033750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891658e9-03f8-4f64-93a4-36535d6dd494 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:01.033985 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891658e9-03f8-4f64-93a4-36535d6dd494 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:01.034582 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891658e9-03f8-4f64-93a4-36535d6dd494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:01.048389 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-891658e9-03f8-4f64-93a4-36535d6dd494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:01.071477 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891658e9-03f8-4f64-93a4-36535d6dd494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:01.073710 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891658e9-03f8-4f64-93a4-36535d6dd494 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:01.088227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1396/2792] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:05.080272 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d56b-b6cc-4e6c-91ab-85919634c19f service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:05.144939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d56b-b6cc-4e6c-91ab-85919634c19f service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:05.149725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:05.150372 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:05.150661 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:05.151084 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] PATH_INFO: `/v3/users/fcf1f811b07c4d76aeffcea22924229d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:05.152311 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf1f811b07c4d76aeffcea22924229d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:05.154282 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:05.213969 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf1f811b07c4d76aeffcea22924229d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.222576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf1f811b07c4d76aeffcea22924229d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.223142 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf1f811b07c4d76aeffcea22924229d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.243500 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf1f811b07c4d76aeffcea22924229d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.244441 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf1f811b07c4d76aeffcea22924229d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.259504 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1397/2793] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:05 2022] DELETE /identity/v3/users/fcf1f811b07c4d76aeffcea22924229d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:05.264022 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d0b3-a98e-4016-a27b-8223057c3ed6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:05.264879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d0b3-a98e-4016-a27b-8223057c3ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:05.265165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d0b3-a98e-4016-a27b-8223057c3ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:05.284894 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3df7d0b3-a98e-4016-a27b-8223057c3ed6 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:05.285856 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3df7d0b3-a98e-4016-a27b-8223057c3ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:05.359541 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1397/2794] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:05.368625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:05.370058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:05.415613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:05.435900 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7a511-bfe7-4cca-8e1f-1c012210069c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:05.440088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802e745-e91d-4fc0-918e-4027f66dec8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:05.440716 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802e745-e91d-4fc0-918e-4027f66dec8d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:05.440997 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802e745-e91d-4fc0-918e-4027f66dec8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:05.441271 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802e745-e91d-4fc0-918e-4027f66dec8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:05.450629 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802e745-e91d-4fc0-918e-4027f66dec8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:05.452098 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802e745-e91d-4fc0-918e-4027f66dec8d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:05.462197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1398/2795] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:49:05.741625 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d0b3-a98e-4016-a27b-8223057c3ed6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:05.743303 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3df7d0b3-a98e-4016-a27b-8223057c3ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:05.758219 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d0b3-a98e-4016-a27b-8223057c3ed6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:05.762782 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:05.764026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:05.764980 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:05.765609 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] PATH_INFO: `/v3/projects/12254ada29bf4009a41171945623cfb5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:05.766800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12254ada29bf4009a41171945623cfb5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:05.768746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:05.804864 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:05.819520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12254ada29bf4009a41171945623cfb5', 'request_id': 'req-c9660417-3fd8-49c6-8085-0658a0bbb1e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.827758 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12254ada29bf4009a41171945623cfb5', 'request_id': 'req-c9660417-3fd8-49c6-8085-0658a0bbb1e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.833370 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12254ada29bf4009a41171945623cfb5', 'request_id': 'req-c9660417-3fd8-49c6-8085-0658a0bbb1e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.844270 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] The token cache is being invalidate because project 12254ada29bf4009a41171945623cfb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:05.844562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.845197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.846885 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1398/2796] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:05 2022] DELETE /identity/v3/projects/12254ada29bf4009a41171945623cfb5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:05.851149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802e745-e91d-4fc0-918e-4027f66dec8d service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:05.861588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802e745-e91d-4fc0-918e-4027f66dec8d service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:05.919401 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:05.920644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:05.920928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:05.921205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] PATH_INFO: `/v3/users/4e3bae4630104adbb7a3431c371ba9e8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:05.922385 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3bae4630104adbb7a3431c371ba9e8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:05.924418 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:05.971210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3bae4630104adbb7a3431c371ba9e8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.979465 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3bae4630104adbb7a3431c371ba9e8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.980030 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3bae4630104adbb7a3431c371ba9e8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.995221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3bae4630104adbb7a3431c371ba9e8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:05.996091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3bae4630104adbb7a3431c371ba9e8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.012275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1399/2797] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:05 2022] DELETE /identity/v3/users/4e3bae4630104adbb7a3431c371ba9e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:06.319721 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:06.321309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:06.337304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9660417-3fd8-49c6-8085-0658a0bbb1e3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:06.402116 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:06.402770 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:06.403113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:06.403309 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] PATH_INFO: `/v3/projects/1075a04776374d68849f5828dcc9567c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:06.406301 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1075a04776374d68849f5828dcc9567c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:06.408281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:06.458727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1075a04776374d68849f5828dcc9567c', 'request_id': 'req-dd136b9d-fa22-432a-9d23-52c4588c3a09'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.467526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1075a04776374d68849f5828dcc9567c', 'request_id': 'req-dd136b9d-fa22-432a-9d23-52c4588c3a09'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.474579 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1075a04776374d68849f5828dcc9567c', 'request_id': 'req-dd136b9d-fa22-432a-9d23-52c4588c3a09'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.489277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] The token cache is being invalidate because project 1075a04776374d68849f5828dcc9567c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:06.489526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.490144 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.492014 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1399/2798] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:06 2022] DELETE /identity/v3/projects/1075a04776374d68849f5828dcc9567c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:49:06.495892 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:06.497366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:06.511132 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3172-8a0f-4833-ac87-7dc68edc89cf admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:06.567795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:06.576221 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:06.577407 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:06.577811 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:06.578171 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] PATH_INFO: `/v3/users/7ae65ad32199424aadec25a7ea68a8a3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:06.579585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae65ad32199424aadec25a7ea68a8a3)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:06.582635 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:06.629682 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae65ad32199424aadec25a7ea68a8a3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.638715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae65ad32199424aadec25a7ea68a8a3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.639336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae65ad32199424aadec25a7ea68a8a3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.651988 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae65ad32199424aadec25a7ea68a8a3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.652675 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28be1a73-b754-407f-97db-50db8b7d332f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae65ad32199424aadec25a7ea68a8a3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:06.665599 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1400/2799] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:06 2022] DELETE /identity/v3/users/7ae65ad32199424aadec25a7ea68a8a3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:06.945695 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:06.947291 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:06.961280 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd136b9d-fa22-432a-9d23-52c4588c3a09 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:07.011959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:07.027675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:07.028343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.028624 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.028903 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] PATH_INFO: `/v3/projects/1676bc0a69fb43d7bb9ee634506a79f4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.030079 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1676bc0a69fb43d7bb9ee634506a79f4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:07.032068 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:07.078945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1676bc0a69fb43d7bb9ee634506a79f4', 'request_id': 'req-7fae08c6-818c-4d94-8e5b-da1d8a279a93'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:07.086663 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1676bc0a69fb43d7bb9ee634506a79f4', 'request_id': 'req-7fae08c6-818c-4d94-8e5b-da1d8a279a93'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:07.092557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1676bc0a69fb43d7bb9ee634506a79f4', 'request_id': 'req-7fae08c6-818c-4d94-8e5b-da1d8a279a93'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:07.104012 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] The token cache is being invalidate because project 1676bc0a69fb43d7bb9ee634506a79f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:07.104305 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:07.104959 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7fae08c6-818c-4d94-8e5b-da1d8a279a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:07.106448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1400/2800] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:06 2022] DELETE /identity/v3/projects/1676bc0a69fb43d7bb9ee634506a79f4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:49:07.111564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349ca26-4a59-4ae0-8836-857607b3fb17 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.111859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349ca26-4a59-4ae0-8836-857607b3fb17 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.112141 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349ca26-4a59-4ae0-8836-857607b3fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.132065 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4349ca26-4a59-4ae0-8836-857607b3fb17 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:07.133280 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4349ca26-4a59-4ae0-8836-857607b3fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:07.196008 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1401/2801] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:07.204662 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba582-4f04-4868-a29b-905201572787 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.205023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba582-4f04-4868-a29b-905201572787 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.205374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba582-4f04-4868-a29b-905201572787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.225586 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f65ba582-4f04-4868-a29b-905201572787 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:07.226826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f65ba582-4f04-4868-a29b-905201572787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:07.234901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1401/2802] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:49:07.239348 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349ca26-4a59-4ae0-8836-857607b3fb17 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:07.252051 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349ca26-4a59-4ae0-8836-857607b3fb17 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:07.256586 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:07.257202 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.257482 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.257756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.258445 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:49:07.258750 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:07.260392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:07.273548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1402/2803] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:49:07.277755 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba582-4f04-4868-a29b-905201572787 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:07.288726 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba582-4f04-4868-a29b-905201572787 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:07.293830 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738dd02-3863-488b-b3c0-b8140171398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:07.295041 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738dd02-3863-488b-b3c0-b8140171398b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.295650 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738dd02-3863-488b-b3c0-b8140171398b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.295844 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738dd02-3863-488b-b3c0-b8140171398b admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.296401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738dd02-3863-488b-b3c0-b8140171398b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:07.298312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738dd02-3863-488b-b3c0-b8140171398b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:07.341088 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1402/2804] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:49:07 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:49:07.345400 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:07.356562 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad148ef-2020-4b8c-a522-fa2f3b1edd47 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:07.414692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc83d9-d302-4f7f-b887-e54670110448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:07.415315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc83d9-d302-4f7f-b887-e54670110448 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.415668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc83d9-d302-4f7f-b887-e54670110448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.415908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc83d9-d302-4f7f-b887-e54670110448 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.416616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc83d9-d302-4f7f-b887-e54670110448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:07.418490 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc83d9-d302-4f7f-b887-e54670110448 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:07.429435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:07.447430 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1403/2805] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:49:07 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:49:07.451296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738dd02-3863-488b-b3c0-b8140171398b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:07.465199 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738dd02-3863-488b-b3c0-b8140171398b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:07.472122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c23ca-2852-47f2-8eef-d7ee30e564b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:07.472788 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c23ca-2852-47f2-8eef-d7ee30e564b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.473080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c23ca-2852-47f2-8eef-d7ee30e564b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.473435 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c23ca-2852-47f2-8eef-d7ee30e564b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.474107 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c23ca-2852-47f2-8eef-d7ee30e564b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:07.476035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c23ca-2852-47f2-8eef-d7ee30e564b6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:07.488279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1403/2806] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:07.493336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc83d9-d302-4f7f-b887-e54670110448 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:07.510895 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc83d9-d302-4f7f-b887-e54670110448 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:07.529467 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba61550-b8bf-4830-9558-ba441ccb5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:07.530118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61550-b8bf-4830-9558-ba441ccb5596 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.530468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61550-b8bf-4830-9558-ba441ccb5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.530808 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61550-b8bf-4830-9558-ba441ccb5596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.531671 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba61550-b8bf-4830-9558-ba441ccb5596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:07.533409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba61550-b8bf-4830-9558-ba441ccb5596 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:07.550423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1404/2807] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:07.551673 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c23ca-2852-47f2-8eef-d7ee30e564b6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:07.564281 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c23ca-2852-47f2-8eef-d7ee30e564b6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:07.569930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:07.570701 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.572796 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.573198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] PATH_INFO: `/v3/projects/5af8bb36ea304cda895f0d7c1c0d9b0b/users/3a271242e3c84e6dab6a13de4e6777d3/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.610369 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af8bb36ea304cda895f0d7c1c0d9b0b, user_id=3a271242e3c84e6dab6a13de4e6777d3, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:07.613631 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:07.635443 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1404/2808] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:49:07 2022] PUT /identity/v3/projects/5af8bb36ea304cda895f0d7c1c0d9b0b/users/3a271242e3c84e6dab6a13de4e6777d3/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:07.643107 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aabc-b72b-4c84-8d42-6e59a3205112 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.643423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aabc-b72b-4c84-8d42-6e59a3205112 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.643707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aabc-b72b-4c84-8d42-6e59a3205112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.678371 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a5e7aabc-b72b-4c84-8d42-6e59a3205112 None None] MFA Rules not processed for user `3a271242e3c84e6dab6a13de4e6777d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:07.679656 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a5e7aabc-b72b-4c84-8d42-6e59a3205112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:07.756236 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1405/2809] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:07.769530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:07.771437 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:07.866448 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00703f-0a95-431c-917a-d781ac0a4ae6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:07.870674 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03250eb151044619c0f720f315b8509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:07.871317 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:07.871637 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:07.871901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:07.881540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:07.882984 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:07.887738 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:07.893511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1405/2810] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:08.944393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3bbe4-6a5d-468e-903a-e9b1bfc1ec2f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:08.944393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3bbe4-6a5d-468e-903a-e9b1bfc1ec2f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:08.944393 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3bbe4-6a5d-468e-903a-e9b1bfc1ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:08.990796 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0cd3bbe4-6a5d-468e-903a-e9b1bfc1ec2f None None] MFA Rules not processed for user `c258d2b109444c4493bcddcfd6c0d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:08.992053 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0cd3bbe4-6a5d-468e-903a-e9b1bfc1ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:09.069992 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1406/2811] 10.222.0.71 () {58 vars in 967 bytes} [Mon Aug 1 15:49:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:49:09.112968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:09.114961 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:09.216195 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe040c91-9ae3-4b61-97f1-6964cfe7a4e2 service glance] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:09.221232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f244b-9847-4244-8327-690996c37c5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2434616a540474f948c821e18e1a112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:09.221855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f244b-9847-4244-8327-690996c37c5d service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:09.222135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f244b-9847-4244-8327-690996c37c5d service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:09.222406 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f244b-9847-4244-8327-690996c37c5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:09.231029 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f244b-9847-4244-8327-690996c37c5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:09.232697 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f244b-9847-4244-8327-690996c37c5d service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:09.244133 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1406/2812] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Aug 1 15:49:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:49:16.486565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3bbe4-6a5d-468e-903a-e9b1bfc1ec2f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:16.488028 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0cd3bbe4-6a5d-468e-903a-e9b1bfc1ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:16.547657 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:16.569373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3bbe4-6a5d-468e-903a-e9b1bfc1ec2f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:16.574335 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:16.574931 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:16.575210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:16.576047 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] PATH_INFO: `/v3/users/783182ac7f354aa59c88f9dbeb715bac` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:16.577229 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783182ac7f354aa59c88f9dbeb715bac)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:16.579572 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:16.638936 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783182ac7f354aa59c88f9dbeb715bac'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:16.647528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783182ac7f354aa59c88f9dbeb715bac'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:16.648136 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783182ac7f354aa59c88f9dbeb715bac'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:16.664191 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783182ac7f354aa59c88f9dbeb715bac'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:16.665023 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783182ac7f354aa59c88f9dbeb715bac'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:16.679151 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1407/2813] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:16 2022] DELETE /identity/v3/users/783182ac7f354aa59c88f9dbeb715bac => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:16.870181 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f244b-9847-4244-8327-690996c37c5d service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:16.889636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f244b-9847-4244-8327-690996c37c5d service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:16.964663 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:16.964972 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:16.965263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:16.965548 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] PATH_INFO: `/v3/projects/176ae4b7fad74d239b19248fd2d5b9cb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:16.968033 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176ae4b7fad74d239b19248fd2d5b9cb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:16.970369 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:17.036216 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176ae4b7fad74d239b19248fd2d5b9cb', 'request_id': 'req-441afae4-01f8-4f6d-962a-131453fcc138'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.043854 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176ae4b7fad74d239b19248fd2d5b9cb', 'request_id': 'req-441afae4-01f8-4f6d-962a-131453fcc138'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.050375 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176ae4b7fad74d239b19248fd2d5b9cb', 'request_id': 'req-441afae4-01f8-4f6d-962a-131453fcc138'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.062766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:17.064411 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] The token cache is being invalidate because project 176ae4b7fad74d239b19248fd2d5b9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:17.064821 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.065808 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.067991 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1407/2814] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:16 2022] DELETE /identity/v3/projects/176ae4b7fad74d239b19248fd2d5b9cb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:17.072068 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:17.073741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:17.089541 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5af9-a566-4a1a-96bf-7245fee3a0f1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:17.167701 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:17.168356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:17.168638 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:17.168911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] PATH_INFO: `/v3/users/0a029a1fb3984f62823c1c248364fffc` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:17.170197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a029a1fb3984f62823c1c248364fffc)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:17.172264 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:17.227178 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a029a1fb3984f62823c1c248364fffc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.237957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a029a1fb3984f62823c1c248364fffc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.243488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a029a1fb3984f62823c1c248364fffc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.256473 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:17.261941 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a029a1fb3984f62823c1c248364fffc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.262835 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a029a1fb3984f62823c1c248364fffc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.280224 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1408/2815] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:17 2022] DELETE /identity/v3/users/0a029a1fb3984f62823c1c248364fffc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:49:17.482773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:17.484387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:17.504232 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441afae4-01f8-4f6d-962a-131453fcc138 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:17.568031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:17.569312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:17.569312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:17.569312 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] PATH_INFO: `/v3/projects/4d458c6d1ce7495587d8cb8fd9ad8036` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:17.570458 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d458c6d1ce7495587d8cb8fd9ad8036)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:17.572506 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:17.633739 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d458c6d1ce7495587d8cb8fd9ad8036', 'request_id': 'req-c2c95a27-56cc-42c8-878a-379c4b618cb9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.642855 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d458c6d1ce7495587d8cb8fd9ad8036', 'request_id': 'req-c2c95a27-56cc-42c8-878a-379c4b618cb9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.658871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d458c6d1ce7495587d8cb8fd9ad8036', 'request_id': 'req-c2c95a27-56cc-42c8-878a-379c4b618cb9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.675901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] The token cache is being invalidate because project 4d458c6d1ce7495587d8cb8fd9ad8036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:17.676621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.677374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:17.684403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1408/2816] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:17 2022] DELETE /identity/v3/projects/4d458c6d1ce7495587d8cb8fd9ad8036 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:18.265998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:18.267727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:18.283920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eab057-8b78-485c-83e8-8beb9636221a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:18.345409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:18.346064 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:18.346345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:18.346618 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] PATH_INFO: `/v3/users/5aaed1485ca140c78c30f74a23cd4b65` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:18.348129 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aaed1485ca140c78c30f74a23cd4b65)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:18.350108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:18.396849 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aaed1485ca140c78c30f74a23cd4b65'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.407222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aaed1485ca140c78c30f74a23cd4b65'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.407884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aaed1485ca140c78c30f74a23cd4b65'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.426844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aaed1485ca140c78c30f74a23cd4b65'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.427653 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aaed1485ca140c78c30f74a23cd4b65'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.442737 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1409/2817] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:18 2022] DELETE /identity/v3/users/5aaed1485ca140c78c30f74a23cd4b65 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:18.652217 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:18.654372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:18.667793 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95a27-56cc-42c8-878a-379c4b618cb9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:18.730062 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:18.730800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:18.731211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:18.731621 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] PATH_INFO: `/v3/projects/874132ef18844bd28a1e214faf546ec5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:18.732883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=874132ef18844bd28a1e214faf546ec5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:18.734845 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:18.772545 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:18.792750 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874132ef18844bd28a1e214faf546ec5', 'request_id': 'req-5be1b63c-052b-42f0-acec-7d498c406164'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.802588 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874132ef18844bd28a1e214faf546ec5', 'request_id': 'req-5be1b63c-052b-42f0-acec-7d498c406164'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.809154 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874132ef18844bd28a1e214faf546ec5', 'request_id': 'req-5be1b63c-052b-42f0-acec-7d498c406164'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.824945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] The token cache is being invalidate because project 874132ef18844bd28a1e214faf546ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:18.825236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.826043 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.827698 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1409/2818] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:18 2022] DELETE /identity/v3/projects/874132ef18844bd28a1e214faf546ec5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:18.832279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:18.833861 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:18.846816 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d42c9b-b0fb-4187-930f-8d4ae251a1d7 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:18.913522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:18.914278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:18.914564 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:18.914844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] PATH_INFO: `/v3/users/5b8fef7d95a94c14b913d28eda670b28` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:18.916088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8fef7d95a94c14b913d28eda670b28)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:18.918032 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:18.921360 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:18.979728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8fef7d95a94c14b913d28eda670b28'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.988321 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8fef7d95a94c14b913d28eda670b28'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:18.989104 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8fef7d95a94c14b913d28eda670b28'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:19.002730 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8fef7d95a94c14b913d28eda670b28'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:19.003503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-28c47a27-bba7-4d3c-88d5-99facc7c1ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8fef7d95a94c14b913d28eda670b28'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:19.015576 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1410/2819] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:18 2022] DELETE /identity/v3/users/5b8fef7d95a94c14b913d28eda670b28 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:19.202725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:19.204374 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:19.218512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b63c-052b-42f0-acec-7d498c406164 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:19.279109 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:19.279799 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.280081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.280356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] PATH_INFO: `/v3/projects/e8d56f15083747c5a443e6fcaaef87f4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.281941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d56f15083747c5a443e6fcaaef87f4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:19.283930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:19.334311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d56f15083747c5a443e6fcaaef87f4', 'request_id': 'req-cc50fd7a-bd44-4de8-a8b5-809b14c65682'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:19.341804 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d56f15083747c5a443e6fcaaef87f4', 'request_id': 'req-cc50fd7a-bd44-4de8-a8b5-809b14c65682'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:19.347979 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d56f15083747c5a443e6fcaaef87f4', 'request_id': 'req-cc50fd7a-bd44-4de8-a8b5-809b14c65682'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:19.359790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] The token cache is being invalidate because project e8d56f15083747c5a443e6fcaaef87f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:19.360085 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:19.360746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cc50fd7a-bd44-4de8-a8b5-809b14c65682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:19.362346 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1410/2820] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:19 2022] DELETE /identity/v3/projects/e8d56f15083747c5a443e6fcaaef87f4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:19.367812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3e1b-a470-4d70-94fe-acd970f64024 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.368424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3e1b-a470-4d70-94fe-acd970f64024 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.368424 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3e1b-a470-4d70-94fe-acd970f64024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.389602 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-293d3e1b-a470-4d70-94fe-acd970f64024 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:19.390826 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-293d3e1b-a470-4d70-94fe-acd970f64024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:19.467689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1411/2821] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:19.475327 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83823-78be-4ae5-9bfa-902bee347d6a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.475636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83823-78be-4ae5-9bfa-902bee347d6a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.475907 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83823-78be-4ae5-9bfa-902bee347d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.496034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0ce83823-78be-4ae5-9bfa-902bee347d6a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:19.497363 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0ce83823-78be-4ae5-9bfa-902bee347d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:19.506576 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1411/2822] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:19.510966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d3e1b-a470-4d70-94fe-acd970f64024 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:19.520824 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d3e1b-a470-4d70-94fe-acd970f64024 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:19.525428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:19.526044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.526325 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.526627 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.527329 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:49:19.527669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:19.529274 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:19.540955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1412/2823] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:49:19.545921 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce83823-78be-4ae5-9bfa-902bee347d6a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:19.555649 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce83823-78be-4ae5-9bfa-902bee347d6a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:19.561210 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea4bee-09ec-45a8-a2eb-f08e70d09d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:19.561816 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea4bee-09ec-45a8-a2eb-f08e70d09d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.562098 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea4bee-09ec-45a8-a2eb-f08e70d09d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.562403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea4bee-09ec-45a8-a2eb-f08e70d09d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.563075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea4bee-09ec-45a8-a2eb-f08e70d09d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:19.565037 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea4bee-09ec-45a8-a2eb-f08e70d09d49 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:19.592558 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1412/2824] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:49:19 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:49:19.596644 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:19.607394 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47544-6135-4243-bca3-fe52fa9219c9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:19.664740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879b8d3-e74c-4947-aa47-1b1346c414bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:19.665409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879b8d3-e74c-4947-aa47-1b1346c414bd admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.665691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879b8d3-e74c-4947-aa47-1b1346c414bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.665966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879b8d3-e74c-4947-aa47-1b1346c414bd admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.666640 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879b8d3-e74c-4947-aa47-1b1346c414bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:19.668582 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879b8d3-e74c-4947-aa47-1b1346c414bd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:19.684428 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:19.690940 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1413/2825] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:49:19 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:49:19.695391 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea4bee-09ec-45a8-a2eb-f08e70d09d49 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:19.705883 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea4bee-09ec-45a8-a2eb-f08e70d09d49 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:19.710643 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58514-4504-41ce-832e-bc53e40fa174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:19.711248 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58514-4504-41ce-832e-bc53e40fa174 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.711562 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58514-4504-41ce-832e-bc53e40fa174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.711838 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58514-4504-41ce-832e-bc53e40fa174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.712526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58514-4504-41ce-832e-bc53e40fa174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:19.714106 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58514-4504-41ce-832e-bc53e40fa174 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:19.724514 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1413/2826] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:19.728596 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879b8d3-e74c-4947-aa47-1b1346c414bd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:19.739571 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879b8d3-e74c-4947-aa47-1b1346c414bd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:19.744209 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c45ba7-657e-4d8c-ba46-ba48547e3587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:19.744812 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c45ba7-657e-4d8c-ba46-ba48547e3587 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.745088 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c45ba7-657e-4d8c-ba46-ba48547e3587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.745359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c45ba7-657e-4d8c-ba46-ba48547e3587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.746097 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c45ba7-657e-4d8c-ba46-ba48547e3587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:19.747838 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c45ba7-657e-4d8c-ba46-ba48547e3587 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:19.757825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1414/2827] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:19.762052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58514-4504-41ce-832e-bc53e40fa174 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:19.772227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58514-4504-41ce-832e-bc53e40fa174 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:19.776966 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:19.777611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.777896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.778172 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] PATH_INFO: `/v3/projects/c64fd76f2cd7472abd981fe0ad065738/users/35ead908d22941f680b1d0ca20a04181/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.787001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:19.796080 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64fd76f2cd7472abd981fe0ad065738, user_id=35ead908d22941f680b1d0ca20a04181, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:19.799249 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:19.812084 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1414/2828] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:49:19 2022] PUT /identity/v3/projects/c64fd76f2cd7472abd981fe0ad065738/users/35ead908d22941f680b1d0ca20a04181/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:19.822218 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430a57-1367-442e-8498-511a03d07271 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:19.822503 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430a57-1367-442e-8498-511a03d07271 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:19.822784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430a57-1367-442e-8498-511a03d07271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:19.850695 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-23430a57-1367-442e-8498-511a03d07271 None None] MFA Rules not processed for user `35ead908d22941f680b1d0ca20a04181`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:19.851851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-23430a57-1367-442e-8498-511a03d07271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:19.918015 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1415/2829] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:19.932169 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:19.934173 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:20.000945 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6dbc4-838c-497c-a5ae-46cc14768f45 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:20.004599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1649d-fd22-40a3-bc94-a6d8eaf644b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:20.005227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1649d-fd22-40a3-bc94-a6d8eaf644b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:20.005515 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1649d-fd22-40a3-bc94-a6d8eaf644b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:20.005800 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1649d-fd22-40a3-bc94-a6d8eaf644b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:20.014120 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1649d-fd22-40a3-bc94-a6d8eaf644b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:20.015610 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1649d-fd22-40a3-bc94-a6d8eaf644b8 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:20.024867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1415/2830] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:20.047133 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430a57-1367-442e-8498-511a03d07271 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:20.110799 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430a57-1367-442e-8498-511a03d07271 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:20.116017 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:20.116668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:20.116939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:20.117214 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] PATH_INFO: `/v3/users/35ead908d22941f680b1d0ca20a04181` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:20.118392 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ead908d22941f680b1d0ca20a04181)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:20.120588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:20.182404 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ead908d22941f680b1d0ca20a04181'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.190409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ead908d22941f680b1d0ca20a04181'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.191044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ead908d22941f680b1d0ca20a04181'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.203867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ead908d22941f680b1d0ca20a04181'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.204522 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ead908d22941f680b1d0ca20a04181'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.210004 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:20.219776 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1416/2831] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:20 2022] DELETE /identity/v3/users/35ead908d22941f680b1d0ca20a04181 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:20.224513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128ba08-9b3a-495f-a649-089209800f57 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:20.224806 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128ba08-9b3a-495f-a649-089209800f57 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:20.225089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128ba08-9b3a-495f-a649-089209800f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:20.244807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a128ba08-9b3a-495f-a649-089209800f57 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:20.246026 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a128ba08-9b3a-495f-a649-089209800f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:20.308267 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1416/2832] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:20.318710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:20.320188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:20.381067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6dc0b-606f-4f11-9747-ee4b28df1ef6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:20.385613 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e326848-eea9-47a7-b883-51fa0efcba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:20.386275 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326848-eea9-47a7-b883-51fa0efcba5d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:20.386585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326848-eea9-47a7-b883-51fa0efcba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:20.386935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326848-eea9-47a7-b883-51fa0efcba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:20.396708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e326848-eea9-47a7-b883-51fa0efcba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:20.398143 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e326848-eea9-47a7-b883-51fa0efcba5d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:20.407786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1417/2833] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:20.681390 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128ba08-9b3a-495f-a649-089209800f57 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:20.682896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a128ba08-9b3a-495f-a649-089209800f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:20.695452 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128ba08-9b3a-495f-a649-089209800f57 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:20.700593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:20.701441 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:20.701681 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:20.701999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] PATH_INFO: `/v3/projects/c64fd76f2cd7472abd981fe0ad065738` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:20.703191 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64fd76f2cd7472abd981fe0ad065738)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:20.705132 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:20.754148 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64fd76f2cd7472abd981fe0ad065738', 'request_id': 'req-a9ed30a6-38cb-48a1-84c4-91c98506afcc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.762384 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64fd76f2cd7472abd981fe0ad065738', 'request_id': 'req-a9ed30a6-38cb-48a1-84c4-91c98506afcc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.769036 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64fd76f2cd7472abd981fe0ad065738', 'request_id': 'req-a9ed30a6-38cb-48a1-84c4-91c98506afcc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.780589 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] The token cache is being invalidate because project c64fd76f2cd7472abd981fe0ad065738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:20.780884 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.782099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9ed30a6-38cb-48a1-84c4-91c98506afcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:20.783930 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1417/2834] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:20 2022] DELETE /identity/v3/projects/c64fd76f2cd7472abd981fe0ad065738 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:20.788914 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a30-a1fd-4e9b-bc55-da8f5f3cb9b8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:20.789320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a30-a1fd-4e9b-bc55-da8f5f3cb9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:20.789740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a30-a1fd-4e9b-bc55-da8f5f3cb9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:20.811066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a0011a30-a1fd-4e9b-bc55-da8f5f3cb9b8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:20.812296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a0011a30-a1fd-4e9b-bc55-da8f5f3cb9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:20.875255 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1418/2835] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:20.941449 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae4df-4dfc-4f7b-88a4-74323b8b4487 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:20.941737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae4df-4dfc-4f7b-88a4-74323b8b4487 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:20.942016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae4df-4dfc-4f7b-88a4-74323b8b4487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:20.962620 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3c6ae4df-4dfc-4f7b-88a4-74323b8b4487 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:20.963901 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3c6ae4df-4dfc-4f7b-88a4-74323b8b4487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:20.972261 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1418/2836] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:20.976904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011a30-a1fd-4e9b-bc55-da8f5f3cb9b8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:20.988493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011a30-a1fd-4e9b-bc55-da8f5f3cb9b8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:20.993786 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:20.994654 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:20.995113 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:20.995632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:20.996700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:49:20.997172 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:21.000472 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:21.013770 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1419/2837] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:49:21.018492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ae4df-4dfc-4f7b-88a4-74323b8b4487 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:21.027960 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ae4df-4dfc-4f7b-88a4-74323b8b4487 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:21.032995 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d1730-20b7-4774-a686-d77ad6c55c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:21.033611 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d1730-20b7-4774-a686-d77ad6c55c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:21.033896 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d1730-20b7-4774-a686-d77ad6c55c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:21.034174 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d1730-20b7-4774-a686-d77ad6c55c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:21.038967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d1730-20b7-4774-a686-d77ad6c55c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:21.038967 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d1730-20b7-4774-a686-d77ad6c55c24 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:21.042729 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:21.068531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1419/2838] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:49:21 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:49:21.073554 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:21.085521 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98894a79-ac24-4048-b186-1f9f9b52c536 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:21.141771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cdec8-8f2b-42c2-bec3-f8914f9ff74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:21.142306 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cdec8-8f2b-42c2-bec3-f8914f9ff74e admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:21.142588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cdec8-8f2b-42c2-bec3-f8914f9ff74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:21.142865 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cdec8-8f2b-42c2-bec3-f8914f9ff74e admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:21.143580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cdec8-8f2b-42c2-bec3-f8914f9ff74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:21.145488 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cdec8-8f2b-42c2-bec3-f8914f9ff74e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:21.166726 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1420/2839] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:49:21 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:49:21.170801 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d1730-20b7-4774-a686-d77ad6c55c24 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:21.182193 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d1730-20b7-4774-a686-d77ad6c55c24 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:21.187648 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba9cef-ba8b-4371-a0b4-e75a2c76d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:21.188271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba9cef-ba8b-4371-a0b4-e75a2c76d631 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:21.188554 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba9cef-ba8b-4371-a0b4-e75a2c76d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:21.188832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba9cef-ba8b-4371-a0b4-e75a2c76d631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:21.189527 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba9cef-ba8b-4371-a0b4-e75a2c76d631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:21.191725 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba9cef-ba8b-4371-a0b4-e75a2c76d631 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:21.202534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1420/2840] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:21.207146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cdec8-8f2b-42c2-bec3-f8914f9ff74e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:21.218036 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cdec8-8f2b-42c2-bec3-f8914f9ff74e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:21.222928 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06aa8f-522e-478d-9085-94a5a752dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:21.223616 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06aa8f-522e-478d-9085-94a5a752dc14 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:21.223904 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06aa8f-522e-478d-9085-94a5a752dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:21.224184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06aa8f-522e-478d-9085-94a5a752dc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:21.224884 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06aa8f-522e-478d-9085-94a5a752dc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:21.226497 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06aa8f-522e-478d-9085-94a5a752dc14 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:21.239226 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1421/2841] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:21.244228 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba9cef-ba8b-4371-a0b4-e75a2c76d631 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:21.258644 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba9cef-ba8b-4371-a0b4-e75a2c76d631 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:21.264038 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:21.264714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:21.264997 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:21.265273 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] PATH_INFO: `/v3/projects/7cdd292091044c1d9bacd772e36dd84a/users/e45178e7aae54d2e93b9a1468634401c/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:21.281168 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdd292091044c1d9bacd772e36dd84a, user_id=e45178e7aae54d2e93b9a1468634401c, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:21.283868 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:21.297271 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1421/2842] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:49:21 2022] PUT /identity/v3/projects/7cdd292091044c1d9bacd772e36dd84a/users/e45178e7aae54d2e93b9a1468634401c/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:21.307876 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b2a9-85ac-438b-9a4a-526524069b9a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:21.308188 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b2a9-85ac-438b-9a4a-526524069b9a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:21.308512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b2a9-85ac-438b-9a4a-526524069b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:21.317621 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:21.339669 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c554b2a9-85ac-438b-9a4a-526524069b9a None None] MFA Rules not processed for user `e45178e7aae54d2e93b9a1468634401c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:21.340919 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c554b2a9-85ac-438b-9a4a-526524069b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:21.413585 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1422/2843] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:21.426464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:21.429099 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:21.499278 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e2af-0a84-4fa5-817f-6886448fdc0b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:21.503279 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c085c-8234-4900-b89c-024b04acb472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:21.503988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c085c-8234-4900-b89c-024b04acb472 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:21.504272 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c085c-8234-4900-b89c-024b04acb472 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:21.504560 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c085c-8234-4900-b89c-024b04acb472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:21.514401 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c085c-8234-4900-b89c-024b04acb472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:21.515881 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c085c-8234-4900-b89c-024b04acb472 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:21.525403 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1422/2844] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:27.976957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554b2a9-85ac-438b-9a4a-526524069b9a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:28.045304 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554b2a9-85ac-438b-9a4a-526524069b9a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:28.049825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:28.050478 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.050756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.051038 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] PATH_INFO: `/v3/users/e45178e7aae54d2e93b9a1468634401c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.052241 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45178e7aae54d2e93b9a1468634401c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:28.054170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:28.099999 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45178e7aae54d2e93b9a1468634401c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.107690 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45178e7aae54d2e93b9a1468634401c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.108309 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45178e7aae54d2e93b9a1468634401c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.120615 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45178e7aae54d2e93b9a1468634401c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.121256 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45178e7aae54d2e93b9a1468634401c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.133768 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1423/2845] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:27 2022] DELETE /identity/v3/users/e45178e7aae54d2e93b9a1468634401c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:28.138848 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a935209-b34c-49cc-ac81-5befb449d5c8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.139352 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a935209-b34c-49cc-ac81-5befb449d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.139503 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a935209-b34c-49cc-ac81-5befb449d5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.160283 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9a935209-b34c-49cc-ac81-5befb449d5c8 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:28.161504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9a935209-b34c-49cc-ac81-5befb449d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.223837 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1423/2846] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:28.233867 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:28.235413 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.250359 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:28.295841 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c8511-eef0-4079-8fb5-86c8d00dde02 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:28.299540 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877ce0e-e016-4af3-a14a-2e49af1e2bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:28.300200 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877ce0e-e016-4af3-a14a-2e49af1e2bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.300439 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877ce0e-e016-4af3-a14a-2e49af1e2bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.300727 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877ce0e-e016-4af3-a14a-2e49af1e2bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.310086 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877ce0e-e016-4af3-a14a-2e49af1e2bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:28.311544 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877ce0e-e016-4af3-a14a-2e49af1e2bc8 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:28.321139 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1424/2847] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:28.605626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a935209-b34c-49cc-ac81-5befb449d5c8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:28.607050 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9a935209-b34c-49cc-ac81-5befb449d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.618958 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a935209-b34c-49cc-ac81-5befb449d5c8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:28.625072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:28.625926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.626319 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.626727 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] PATH_INFO: `/v3/projects/7cdd292091044c1d9bacd772e36dd84a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.628140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cdd292091044c1d9bacd772e36dd84a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:28.630373 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:28.684428 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:28.687065 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdd292091044c1d9bacd772e36dd84a', 'request_id': 'req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.697224 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdd292091044c1d9bacd772e36dd84a', 'request_id': 'req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.704596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdd292091044c1d9bacd772e36dd84a', 'request_id': 'req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.716225 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] The token cache is being invalidate because project 7cdd292091044c1d9bacd772e36dd84a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:28.716519 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.717171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f45f8bf7-53a5-40a0-a9d7-4190648bbeca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:28.718678 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1424/2848] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:28 2022] DELETE /identity/v3/projects/7cdd292091044c1d9bacd772e36dd84a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:28.724052 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07534d-9c6c-43ac-ba6c-85bb9e182fa0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.724342 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07534d-9c6c-43ac-ba6c-85bb9e182fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.724617 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07534d-9c6c-43ac-ba6c-85bb9e182fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.744903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-aa07534d-9c6c-43ac-ba6c-85bb9e182fa0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:28.746106 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-aa07534d-9c6c-43ac-ba6c-85bb9e182fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.810689 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1425/2849] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:49:28.818660 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520630-7046-4741-9d68-6454f6a30669 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.819115 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520630-7046-4741-9d68-6454f6a30669 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.819455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520630-7046-4741-9d68-6454f6a30669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.843963 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d0520630-7046-4741-9d68-6454f6a30669 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:28.845226 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d0520630-7046-4741-9d68-6454f6a30669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.853765 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1425/2850] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:28.858773 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07534d-9c6c-43ac-ba6c-85bb9e182fa0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:28.869453 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07534d-9c6c-43ac-ba6c-85bb9e182fa0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:28.874843 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:28.875474 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.875759 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.876054 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.876741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:49:28.877501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:28.879083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:28.891795 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1426/2851] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:49:28.897211 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0520630-7046-4741-9d68-6454f6a30669 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:28.906497 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0520630-7046-4741-9d68-6454f6a30669 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:28.911257 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f442-1851-4297-92f2-183ea0793354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:28.911905 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f442-1851-4297-92f2-183ea0793354 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.912187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f442-1851-4297-92f2-183ea0793354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.912460 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f442-1851-4297-92f2-183ea0793354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.913122 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0f442-1851-4297-92f2-183ea0793354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:28.915017 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0f442-1851-4297-92f2-183ea0793354 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:28.945308 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1426/2852] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:49:28 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:49:28.949783 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:28.961891 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37cdae-3f37-4500-b089-c17cda5229c3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:29.030373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551e912-b6eb-490d-9964-039db16ff60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:29.030971 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e912-b6eb-490d-9964-039db16ff60b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:29.031349 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e912-b6eb-490d-9964-039db16ff60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:29.031552 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e912-b6eb-490d-9964-039db16ff60b admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:29.032222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551e912-b6eb-490d-9964-039db16ff60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:29.034534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551e912-b6eb-490d-9964-039db16ff60b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:29.061122 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1427/2853] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:49:28 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:49:29.065274 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f442-1851-4297-92f2-183ea0793354 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:29.077045 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f442-1851-4297-92f2-183ea0793354 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:29.083266 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e38d-4044-4b65-9517-fe88c18a57c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:29.083941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e38d-4044-4b65-9517-fe88c18a57c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:29.084200 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e38d-4044-4b65-9517-fe88c18a57c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:29.084471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e38d-4044-4b65-9517-fe88c18a57c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:29.085171 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028e38d-4044-4b65-9517-fe88c18a57c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:29.087184 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028e38d-4044-4b65-9517-fe88c18a57c3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:29.097879 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1427/2854] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:29.101942 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551e912-b6eb-490d-9964-039db16ff60b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:29.113437 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551e912-b6eb-490d-9964-039db16ff60b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:29.118375 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d5f82-c4c7-4085-8b42-3218407b2895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:29.118829 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d5f82-c4c7-4085-8b42-3218407b2895 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:29.126792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d5f82-c4c7-4085-8b42-3218407b2895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:29.126792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d5f82-c4c7-4085-8b42-3218407b2895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:29.126792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d5f82-c4c7-4085-8b42-3218407b2895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:29.126792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d5f82-c4c7-4085-8b42-3218407b2895 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:29.139477 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1428/2855] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:29.143632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e38d-4044-4b65-9517-fe88c18a57c3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:29.156322 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e38d-4044-4b65-9517-fe88c18a57c3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:29.161442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:29.162113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:29.162423 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:29.162797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] PATH_INFO: `/v3/projects/bba0149709b945f4ae08870c4eb5057a/users/a22a01f2a717409da190184236411dcb/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:29.185784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba0149709b945f4ae08870c4eb5057a, user_id=a22a01f2a717409da190184236411dcb, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:29.188499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:29.202229 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1428/2856] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:49:29 2022] PUT /identity/v3/projects/bba0149709b945f4ae08870c4eb5057a/users/a22a01f2a717409da190184236411dcb/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:49:29.213450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f14a-365d-470a-8af1-b09992d30ea6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:29.213743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f14a-365d-470a-8af1-b09992d30ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:29.214027 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f14a-365d-470a-8af1-b09992d30ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:29.243708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-bff8f14a-365d-470a-8af1-b09992d30ea6 None None] MFA Rules not processed for user `a22a01f2a717409da190184236411dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:29.244939 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bff8f14a-365d-470a-8af1-b09992d30ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:29.254851 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:29.312179 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1429/2857] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:29.323942 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:29.325671 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:29.383536 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e593-e35b-4091-969d-b15856ea3994 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:29.387130 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553923f4-579d-4ab7-9dbe-5cc61aebc917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:29.387798 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553923f4-579d-4ab7-9dbe-5cc61aebc917 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:29.388078 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553923f4-579d-4ab7-9dbe-5cc61aebc917 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:29.388351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553923f4-579d-4ab7-9dbe-5cc61aebc917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:29.396941 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553923f4-579d-4ab7-9dbe-5cc61aebc917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:29.398404 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553923f4-579d-4ab7-9dbe-5cc61aebc917 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:29.407871 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1429/2858] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:36.054044 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f14a-365d-470a-8af1-b09992d30ea6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:36.055534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bff8f14a-365d-470a-8af1-b09992d30ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:36.121187 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f14a-365d-470a-8af1-b09992d30ea6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:36.126307 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:36.126957 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:36.127294 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:36.127784 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] PATH_INFO: `/v3/users/3a271242e3c84e6dab6a13de4e6777d3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:36.128955 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a271242e3c84e6dab6a13de4e6777d3)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:36.130877 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:36.176740 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a271242e3c84e6dab6a13de4e6777d3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.184369 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a271242e3c84e6dab6a13de4e6777d3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.185592 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a271242e3c84e6dab6a13de4e6777d3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.200137 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a271242e3c84e6dab6a13de4e6777d3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.201470 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a271242e3c84e6dab6a13de4e6777d3'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.213747 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1430/2859] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:36 2022] DELETE /identity/v3/users/3a271242e3c84e6dab6a13de4e6777d3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:36.218360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d316-01c1-437a-9514-0f0fe84852e1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:36.218860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d316-01c1-437a-9514-0f0fe84852e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:36.218977 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d316-01c1-437a-9514-0f0fe84852e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:36.239351 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-08a0d316-01c1-437a-9514-0f0fe84852e1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:36.240599 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-08a0d316-01c1-437a-9514-0f0fe84852e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:36.309053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1430/2860] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:36.320777 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:36.322208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:36.368205 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:36.393804 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bafaa5-8da7-42e9-9344-00e370c07306 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:36.397557 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:36.398170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:36.398450 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:36.398724 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:36.408902 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:36.410356 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:36.420908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1431/2861] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:36.695512 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0d316-01c1-437a-9514-0f0fe84852e1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:36.696934 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-08a0d316-01c1-437a-9514-0f0fe84852e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:36.709658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0d316-01c1-437a-9514-0f0fe84852e1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:36.714513 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:36.715227 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:36.715547 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:36.716340 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] PATH_INFO: `/v3/projects/5af8bb36ea304cda895f0d7c1c0d9b0b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:36.717517 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af8bb36ea304cda895f0d7c1c0d9b0b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:36.719464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:36.730946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:36.770826 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af8bb36ea304cda895f0d7c1c0d9b0b', 'request_id': 'req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.779150 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af8bb36ea304cda895f0d7c1c0d9b0b', 'request_id': 'req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.786221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af8bb36ea304cda895f0d7c1c0d9b0b', 'request_id': 'req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.799530 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] The token cache is being invalidate because project 5af8bb36ea304cda895f0d7c1c0d9b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:36.800387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.800944 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0c81d5d3-7ee0-4856-9af2-6b71a7747d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:36.812387 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1431/2862] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:36 2022] DELETE /identity/v3/projects/5af8bb36ea304cda895f0d7c1c0d9b0b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:42.997922 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:42.999402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:43.013117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755cc04-8c83-461b-bee3-81e89a11873b service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:43.070862 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:43.071607 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.071894 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.072173 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] PATH_INFO: `/v3/users/a22a01f2a717409da190184236411dcb` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.073365 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22a01f2a717409da190184236411dcb)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:43.076034 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:43.125970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22a01f2a717409da190184236411dcb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.133646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22a01f2a717409da190184236411dcb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.134276 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22a01f2a717409da190184236411dcb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.147687 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22a01f2a717409da190184236411dcb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.148464 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22a01f2a717409da190184236411dcb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.161691 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1432/2863] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:42 2022] DELETE /identity/v3/users/a22a01f2a717409da190184236411dcb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:43.166187 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872680e-316d-40d8-9cfd-7773968412e0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.166652 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872680e-316d-40d8-9cfd-7773968412e0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.166781 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872680e-316d-40d8-9cfd-7773968412e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.189557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9872680e-316d-40d8-9cfd-7773968412e0 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:43.190774 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9872680e-316d-40d8-9cfd-7773968412e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:43.252818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1432/2864] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:43.262744 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:43.264203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:43.323927 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f700c1-e8f3-4fe8-b863-f080cd2b8068 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:43.328263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729974e-f2b2-41f6-bd48-aa70453b77b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:43.329103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729974e-f2b2-41f6-bd48-aa70453b77b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.329314 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729974e-f2b2-41f6-bd48-aa70453b77b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.329632 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729974e-f2b2-41f6-bd48-aa70453b77b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.337215 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:43.339844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729974e-f2b2-41f6-bd48-aa70453b77b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:43.342046 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729974e-f2b2-41f6-bd48-aa70453b77b4 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:43.353182 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1433/2865] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:43.640294 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872680e-316d-40d8-9cfd-7773968412e0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:43.641753 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9872680e-316d-40d8-9cfd-7773968412e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:43.654240 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872680e-316d-40d8-9cfd-7773968412e0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:43.658946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:43.659865 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.660147 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.660425 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] PATH_INFO: `/v3/projects/bba0149709b945f4ae08870c4eb5057a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.661632 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba0149709b945f4ae08870c4eb5057a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:43.663766 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:43.711807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba0149709b945f4ae08870c4eb5057a', 'request_id': 'req-17ea83ff-fe10-426a-b410-30eb0d4539a0'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.719773 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba0149709b945f4ae08870c4eb5057a', 'request_id': 'req-17ea83ff-fe10-426a-b410-30eb0d4539a0'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.725718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba0149709b945f4ae08870c4eb5057a', 'request_id': 'req-17ea83ff-fe10-426a-b410-30eb0d4539a0'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.737732 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] The token cache is being invalidate because project bba0149709b945f4ae08870c4eb5057a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:43.738051 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.738860 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-17ea83ff-fe10-426a-b410-30eb0d4539a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:43.740438 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1433/2866] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:43 2022] DELETE /identity/v3/projects/bba0149709b945f4ae08870c4eb5057a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:43.745995 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37c1f-ccd3-4a27-9221-be10abd3fc3d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.746286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37c1f-ccd3-4a27-9221-be10abd3fc3d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.746600 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37c1f-ccd3-4a27-9221-be10abd3fc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.767290 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1cb37c1f-ccd3-4a27-9221-be10abd3fc3d None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:43.768558 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1cb37c1f-ccd3-4a27-9221-be10abd3fc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:43.833373 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1434/2867] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:43.841304 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1a79-6087-4fc9-ad6c-0eb9cb44cd99 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.841670 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1a79-6087-4fc9-ad6c-0eb9cb44cd99 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.841873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1a79-6087-4fc9-ad6c-0eb9cb44cd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.862511 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-759b1a79-6087-4fc9-ad6c-0eb9cb44cd99 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:43.863779 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-759b1a79-6087-4fc9-ad6c-0eb9cb44cd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:43.872784 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1434/2868] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:43.877150 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb37c1f-ccd3-4a27-9221-be10abd3fc3d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:43.887089 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb37c1f-ccd3-4a27-9221-be10abd3fc3d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:43.896533 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:43.897491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.897782 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.898056 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.898762 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:49:43.899067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:43.900842 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:43.915738 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1435/2869] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:49:43.920300 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1a79-6087-4fc9-ad6c-0eb9cb44cd99 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:43.929593 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1a79-6087-4fc9-ad6c-0eb9cb44cd99 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:43.934605 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29874b4-beca-43b1-8136-24b66f23598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:43.935212 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29874b4-beca-43b1-8136-24b66f23598d admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.935540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29874b4-beca-43b1-8136-24b66f23598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.935818 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29874b4-beca-43b1-8136-24b66f23598d admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.936492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29874b4-beca-43b1-8136-24b66f23598d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:43.938396 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29874b4-beca-43b1-8136-24b66f23598d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:43.954436 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:43.968378 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1435/2870] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:49:43 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:49:43.972857 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:43.983102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a906c6-6b73-4ff4-9319-795e3283e9c8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:44.050630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381eb4-94a1-453e-b2bc-48b359e0678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:44.051315 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381eb4-94a1-453e-b2bc-48b359e0678e admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.051567 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381eb4-94a1-453e-b2bc-48b359e0678e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.051850 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381eb4-94a1-453e-b2bc-48b359e0678e admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.052528 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5381eb4-94a1-453e-b2bc-48b359e0678e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:44.054499 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5381eb4-94a1-453e-b2bc-48b359e0678e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:44.076960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1436/2871] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:49:43 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:49:44.081360 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29874b4-beca-43b1-8136-24b66f23598d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:44.095042 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29874b4-beca-43b1-8136-24b66f23598d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:44.100276 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f5672-7cf5-4ce1-bd83-0cae2acc4914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:44.100910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5672-7cf5-4ce1-bd83-0cae2acc4914 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.101188 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5672-7cf5-4ce1-bd83-0cae2acc4914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.101464 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5672-7cf5-4ce1-bd83-0cae2acc4914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.102164 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f5672-7cf5-4ce1-bd83-0cae2acc4914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:44.103825 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f5672-7cf5-4ce1-bd83-0cae2acc4914 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:44.114988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1436/2872] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:44.119366 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381eb4-94a1-453e-b2bc-48b359e0678e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:44.131210 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381eb4-94a1-453e-b2bc-48b359e0678e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:44.138705 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6583d0-bab7-4f37-b9fc-05942a80e4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:44.139433 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6583d0-bab7-4f37-b9fc-05942a80e4de admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.139765 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6583d0-bab7-4f37-b9fc-05942a80e4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.140083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6583d0-bab7-4f37-b9fc-05942a80e4de admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.140827 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6583d0-bab7-4f37-b9fc-05942a80e4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:44.142524 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6583d0-bab7-4f37-b9fc-05942a80e4de admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:44.154825 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1437/2873] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:44.159112 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f5672-7cf5-4ce1-bd83-0cae2acc4914 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:44.169534 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f5672-7cf5-4ce1-bd83-0cae2acc4914 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:44.174714 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:44.175471 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.175740 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.176016 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] PATH_INFO: `/v3/projects/e319c0716fb0409a8ea69cbf401fcccb/users/1c7b8c259c544d62a6159d041ad0e66a/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.199311 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e319c0716fb0409a8ea69cbf401fcccb, user_id=1c7b8c259c544d62a6159d041ad0e66a, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:44.203092 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:44.220867 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1437/2874] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:49:44 2022] PUT /identity/v3/projects/e319c0716fb0409a8ea69cbf401fcccb/users/1c7b8c259c544d62a6159d041ad0e66a/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:44.234792 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fccd7-a18d-49c1-bbda-0feca8d727f5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.235096 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fccd7-a18d-49c1-bbda-0feca8d727f5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.235334 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fccd7-a18d-49c1-bbda-0feca8d727f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.266491 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-bb5fccd7-a18d-49c1-bbda-0feca8d727f5 None None] MFA Rules not processed for user `1c7b8c259c544d62a6159d041ad0e66a`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:44.267760 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bb5fccd7-a18d-49c1-bbda-0feca8d727f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:44.321670 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:44.342859 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1438/2875] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:49:44.354296 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:44.356030 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:44.424447 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead31c7-1c3c-4150-b5d5-3ba79e60caa5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:44.428505 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076fc0e-8229-4cd7-bbce-d4ef667c5b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:44.429136 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fc0e-8229-4cd7-bbce-d4ef667c5b7f service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.429465 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fc0e-8229-4cd7-bbce-d4ef667c5b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.429719 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fc0e-8229-4cd7-bbce-d4ef667c5b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.439082 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076fc0e-8229-4cd7-bbce-d4ef667c5b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:44.440783 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076fc0e-8229-4cd7-bbce-d4ef667c5b7f service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:44.451027 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1438/2876] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:44.480918 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fccd7-a18d-49c1-bbda-0feca8d727f5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:44.554080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fccd7-a18d-49c1-bbda-0feca8d727f5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:44.559284 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:44.560534 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.560852 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.561190 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] PATH_INFO: `/v3/users/1c7b8c259c544d62a6159d041ad0e66a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.562435 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7b8c259c544d62a6159d041ad0e66a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:44.565251 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:44.619403 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7b8c259c544d62a6159d041ad0e66a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:44.628357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7b8c259c544d62a6159d041ad0e66a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:44.629003 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7b8c259c544d62a6159d041ad0e66a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:44.641846 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7b8c259c544d62a6159d041ad0e66a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:44.642590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7b8c259c544d62a6159d041ad0e66a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:44.655260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1439/2877] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:49:44 2022] DELETE /identity/v3/users/1c7b8c259c544d62a6159d041ad0e66a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:44.659866 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2134c-72f1-49a3-ad43-af9930680d28 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.660158 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2134c-72f1-49a3-ad43-af9930680d28 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.660468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2134c-72f1-49a3-ad43-af9930680d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.680117 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c6b2134c-72f1-49a3-ad43-af9930680d28 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:44.681629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c6b2134c-72f1-49a3-ad43-af9930680d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:44.741263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1439/2878] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:44.752707 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:44.755405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:44.819014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180e6ee-bfa7-42f3-b118-000171745e6d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:44.822630 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89284e80-9baf-40a9-9076-d5c5d9e434a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:44.823247 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89284e80-9baf-40a9-9076-d5c5d9e434a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.823570 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89284e80-9baf-40a9-9076-d5c5d9e434a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.823834 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89284e80-9baf-40a9-9076-d5c5d9e434a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.834058 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89284e80-9baf-40a9-9076-d5c5d9e434a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:44.835539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89284e80-9baf-40a9-9076-d5c5d9e434a2 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:44.845970 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1440/2879] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:45.127785 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2134c-72f1-49a3-ad43-af9930680d28 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:45.129262 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c6b2134c-72f1-49a3-ad43-af9930680d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:45.146737 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2134c-72f1-49a3-ad43-af9930680d28 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.154618 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.155665 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.156094 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.156564 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] PATH_INFO: `/v3/projects/e319c0716fb0409a8ea69cbf401fcccb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.158372 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e319c0716fb0409a8ea69cbf401fcccb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.160943 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.216313 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e319c0716fb0409a8ea69cbf401fcccb', 'request_id': 'req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:45.224893 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e319c0716fb0409a8ea69cbf401fcccb', 'request_id': 'req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:45.226405 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:45.233035 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e319c0716fb0409a8ea69cbf401fcccb', 'request_id': 'req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:45.249031 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] The token cache is being invalidate because project e319c0716fb0409a8ea69cbf401fcccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:49:45.249459 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:45.250244 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7f3fb82e-bb9f-4e8a-9cd8-3071786673f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:49:45.252307 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1440/2880] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:49:45 2022] DELETE /identity/v3/projects/e319c0716fb0409a8ea69cbf401fcccb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:49:45.257718 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77856b1-f10e-461b-bbbe-a3be3c5d8bf1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.258234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77856b1-f10e-461b-bbbe-a3be3c5d8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.258234 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77856b1-f10e-461b-bbbe-a3be3c5d8bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.280118 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e77856b1-f10e-461b-bbbe-a3be3c5d8bf1 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:45.281345 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e77856b1-f10e-461b-bbbe-a3be3c5d8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:45.290493 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:45.345014 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1441/2881] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:45.352805 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ca83-d5da-4f30-890c-ef12edc0fe97 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.353100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ca83-d5da-4f30-890c-ef12edc0fe97 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.353380 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ca83-d5da-4f30-890c-ef12edc0fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.377087 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b223ca83-d5da-4f30-890c-ef12edc0fe97 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:45.378326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b223ca83-d5da-4f30-890c-ef12edc0fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:45.386429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1441/2882] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:45.391355 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77856b1-f10e-461b-bbbe-a3be3c5d8bf1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:45.401728 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77856b1-f10e-461b-bbbe-a3be3c5d8bf1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.410203 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.410935 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.411263 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.411614 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.412362 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:49:45.412713 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.414368 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.426641 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1442/2883] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Aug 1 15:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:49:45.431407 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223ca83-d5da-4f30-890c-ef12edc0fe97 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:45.440817 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223ca83-d5da-4f30-890c-ef12edc0fe97 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.445499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10159983-adfa-4cf9-b82c-1283135be15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.446113 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159983-adfa-4cf9-b82c-1283135be15e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.446400 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159983-adfa-4cf9-b82c-1283135be15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.446709 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159983-adfa-4cf9-b82c-1283135be15e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.447398 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10159983-adfa-4cf9-b82c-1283135be15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.449333 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10159983-adfa-4cf9-b82c-1283135be15e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.478718 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1442/2884] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Aug 1 15:49:45 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:49:45.483239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:45.493723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136ebb-feab-4e83-9e09-3f41067c20ce admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.552060 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69ce7-80e4-455c-89ec-685d74ed1d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.552743 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69ce7-80e4-455c-89ec-685d74ed1d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.553103 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69ce7-80e4-455c-89ec-685d74ed1d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.553448 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69ce7-80e4-455c-89ec-685d74ed1d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.554155 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d69ce7-80e4-455c-89ec-685d74ed1d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.556456 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d69ce7-80e4-455c-89ec-685d74ed1d05 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.578646 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1443/2885] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Aug 1 15:49:45 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:49:45.583196 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10159983-adfa-4cf9-b82c-1283135be15e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:45.594499 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10159983-adfa-4cf9-b82c-1283135be15e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.599286 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776e28e-7698-4531-8e04-4795981aeea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.599981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776e28e-7698-4531-8e04-4795981aeea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.600263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776e28e-7698-4531-8e04-4795981aeea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.600540 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776e28e-7698-4531-8e04-4795981aeea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.601231 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776e28e-7698-4531-8e04-4795981aeea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.602861 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776e28e-7698-4531-8e04-4795981aeea8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.613242 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1443/2886] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:45.617506 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69ce7-80e4-455c-89ec-685d74ed1d05 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:45.629340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69ce7-80e4-455c-89ec-685d74ed1d05 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.637090 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f31c-ebe3-4f95-8d24-debac1e08a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.638297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f31c-ebe3-4f95-8d24-debac1e08a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.638590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f31c-ebe3-4f95-8d24-debac1e08a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.638863 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f31c-ebe3-4f95-8d24-debac1e08a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.640208 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f31c-ebe3-4f95-8d24-debac1e08a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.641844 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f31c-ebe3-4f95-8d24-debac1e08a45 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.653101 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1444/2887] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Aug 1 15:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:49:45.657473 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776e28e-7698-4531-8e04-4795981aeea8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:45.667596 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776e28e-7698-4531-8e04-4795981aeea8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.672615 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.673277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.673557 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.673832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] PATH_INFO: `/v3/projects/143e4e42565440ec94d82789f9f2d6db/users/aecdb95f1a7f45bfb6d86e588c537cdb/roles/cb911cef057e44fb9c8004a419568df8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.689416 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=143e4e42565440ec94d82789f9f2d6db, user_id=aecdb95f1a7f45bfb6d86e588c537cdb, role_id=cb911cef057e44fb9c8004a419568df8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.692100 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.706988 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1444/2888] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Aug 1 15:49:45 2022] PUT /identity/v3/projects/143e4e42565440ec94d82789f9f2d6db/users/aecdb95f1a7f45bfb6d86e588c537cdb/roles/cb911cef057e44fb9c8004a419568df8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:49:45.712409 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270f7e-3623-4cda-9f5e-1f6e8186633a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.712790 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270f7e-3623-4cda-9f5e-1f6e8186633a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.713117 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270f7e-3623-4cda-9f5e-1f6e8186633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.732513 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a3270f7e-3623-4cda-9f5e-1f6e8186633a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:45.733741 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a3270f7e-3623-4cda-9f5e-1f6e8186633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:45.793320 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1445/2889] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:45.803310 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:45.805075 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:45.864221 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68260c3a-1ad3-44bd-8c1b-936b75aae77d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.867928 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.868549 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.868833 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.869111 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.879023 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.880492 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.890771 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1445/2890] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:46.549381 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658530e8-bb1d-430c-9851-52ac8f8718cd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:46.549966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658530e8-bb1d-430c-9851-52ac8f8718cd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:46.549966 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658530e8-bb1d-430c-9851-52ac8f8718cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:46.584370 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-658530e8-bb1d-430c-9851-52ac8f8718cd None None] MFA Rules not processed for user `aecdb95f1a7f45bfb6d86e588c537cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:46.585597 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-658530e8-bb1d-430c-9851-52ac8f8718cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:46.594376 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:46.661102 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1446/2891] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:49:46.677658 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:46.679121 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:46.744957 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c46dca-1fbc-47cc-bee0-a495798dd255 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:46.749343 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bff50-1eff-4b26-a5cf-13fc758f46e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a4e12e752446f296569df09f2ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:46.749971 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bff50-1eff-4b26-a5cf-13fc758f46e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:46.750256 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bff50-1eff-4b26-a5cf-13fc758f46e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:46.750567 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bff50-1eff-4b26-a5cf-13fc758f46e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:46.760326 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bff50-1eff-4b26-a5cf-13fc758f46e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:46.763071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bff50-1eff-4b26-a5cf-13fc758f46e7 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:46.779584 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1446/2892] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:48.218998 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda52c0-946c-4d0d-80b3-4e51bf1eddd4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:48.219588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda52c0-946c-4d0d-80b3-4e51bf1eddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:48.219588 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda52c0-946c-4d0d-80b3-4e51bf1eddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:48.239327 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8dda52c0-946c-4d0d-80b3-4e51bf1eddd4 None None] MFA Rules not processed for user `aecdb95f1a7f45bfb6d86e588c537cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:48.240581 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8dda52c0-946c-4d0d-80b3-4e51bf1eddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:48.248723 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1447/2893] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:49:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:56.772110 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=2,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:58.234336 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=26 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:23.064813 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf5b6-a2ad-4026-ab53-c08054791baa None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:23.065429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf5b6-a2ad-4026-ab53-c08054791baa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:23.065429 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf5b6-a2ad-4026-ab53-c08054791baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:23.084468 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-94edf5b6-a2ad-4026-ab53-c08054791baa None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:23.085675 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-94edf5b6-a2ad-4026-ab53-c08054791baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:23.093520 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1447/2894] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:23.122123 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda52c0-946c-4d0d-80b3-4e51bf1eddd4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:23.123668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8dda52c0-946c-4d0d-80b3-4e51bf1eddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:23.202766 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda52c0-946c-4d0d-80b3-4e51bf1eddd4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:23.208911 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:23.209548 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:23.209831 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:23.210108 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:23.224603 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:23.226201 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:23.236908 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1448/2895] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:27.174470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69d16-749d-4ddd-83ce-62dd9309acac None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:27.174470 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69d16-749d-4ddd-83ce-62dd9309acac None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:27.175118 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69d16-749d-4ddd-83ce-62dd9309acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:27.194034 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5ff69d16-749d-4ddd-83ce-62dd9309acac None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:27.195236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5ff69d16-749d-4ddd-83ce-62dd9309acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:27.202989 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1448/2896] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:27.233286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:27.234823 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:27.250577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281d9e0-6f3d-4e89-bbb4-a2c9c1b381f9 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:27.263459 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd317-28ec-415f-b804-fa387a5c9767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:27.264115 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd317-28ec-415f-b804-fa387a5c9767 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:27.264408 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd317-28ec-415f-b804-fa387a5c9767 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:27.264679 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd317-28ec-415f-b804-fa387a5c9767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:27.273483 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dd317-28ec-415f-b804-fa387a5c9767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:27.275069 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dd317-28ec-415f-b804-fa387a5c9767 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:27.285222 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1449/2897] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:31.446293 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22b99-781c-49a0-a563-d5a7781c27d5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:31.446892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22b99-781c-49a0-a563-d5a7781c27d5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:31.446892 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22b99-781c-49a0-a563-d5a7781c27d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:31.467566 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2cf22b99-781c-49a0-a563-d5a7781c27d5 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:31.468772 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2cf22b99-781c-49a0-a563-d5a7781c27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:31.476539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1449/2898] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:31.503539 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd317-28ec-415f-b804-fa387a5c9767 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:31.515565 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd317-28ec-415f-b804-fa387a5c9767 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:31.521176 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc4b3-997d-4f24-a9d9-f64beca17eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:31.521789 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc4b3-997d-4f24-a9d9-f64beca17eb7 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:31.522067 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc4b3-997d-4f24-a9d9-f64beca17eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:31.522340 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc4b3-997d-4f24-a9d9-f64beca17eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:31.533159 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fc4b3-997d-4f24-a9d9-f64beca17eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:31.534752 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fc4b3-997d-4f24-a9d9-f64beca17eb7 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:31.545351 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1450/2899] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:34.523594 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7afb-1b91-4d9e-8247-fe608dbad767 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:34.524165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7afb-1b91-4d9e-8247-fe608dbad767 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:34.524165 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7afb-1b91-4d9e-8247-fe608dbad767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:34.544846 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-231c7afb-1b91-4d9e-8247-fe608dbad767 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:34.546064 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-231c7afb-1b91-4d9e-8247-fe608dbad767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:34.555531 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1450/2900] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:50:34.577914 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc4b3-997d-4f24-a9d9-f64beca17eb7 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:34.590297 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc4b3-997d-4f24-a9d9-f64beca17eb7 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:34.596095 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8d1e7-1bd3-4842-8706-fbc8de233930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:34.596700 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8d1e7-1bd3-4842-8706-fbc8de233930 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:34.596978 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8d1e7-1bd3-4842-8706-fbc8de233930 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:34.597260 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8d1e7-1bd3-4842-8706-fbc8de233930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:34.606066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8d1e7-1bd3-4842-8706-fbc8de233930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:34.607674 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8d1e7-1bd3-4842-8706-fbc8de233930 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:34.617501 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1451/2901] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:38.722851 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5ad47-d490-4f7d-ad28-a9b711ad0de9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:38.723442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5ad47-d490-4f7d-ad28-a9b711ad0de9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:38.723442 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5ad47-d490-4f7d-ad28-a9b711ad0de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:38.742926 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a6e5ad47-d490-4f7d-ad28-a9b711ad0de9 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:38.744182 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a6e5ad47-d490-4f7d-ad28-a9b711ad0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:38.752797 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1451/2902] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:38.776815 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8d1e7-1bd3-4842-8706-fbc8de233930 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:38.788610 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8d1e7-1bd3-4842-8706-fbc8de233930 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:38.794756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7864c6-3cc4-4ecb-8f35-3873fca98379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:38.795382 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7864c6-3cc4-4ecb-8f35-3873fca98379 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:38.795683 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7864c6-3cc4-4ecb-8f35-3873fca98379 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:38.795960 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7864c6-3cc4-4ecb-8f35-3873fca98379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:38.804487 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7864c6-3cc4-4ecb-8f35-3873fca98379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:38.806091 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7864c6-3cc4-4ecb-8f35-3873fca98379 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:38.816756 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1452/2903] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:41.900073 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66861578-1063-4b1b-b34f-218637c892c9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:41.900629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66861578-1063-4b1b-b34f-218637c892c9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:41.900629 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66861578-1063-4b1b-b34f-218637c892c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:41.920089 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-66861578-1063-4b1b-b34f-218637c892c9 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:41.921735 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-66861578-1063-4b1b-b34f-218637c892c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:41.929504 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1452/2904] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:41.953130 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7864c6-3cc4-4ecb-8f35-3873fca98379 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:41.964372 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7864c6-3cc4-4ecb-8f35-3873fca98379 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:41.969920 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:41.970527 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:41.970803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:41.971076 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:41.979623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:41.981197 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:41.990938 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1453/2905] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:51.914873 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=18 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:51.986637 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=64 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:57.213734 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21713ea-2af1-4fc2-b327-9475daf6cc9e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:57.215140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21713ea-2af1-4fc2-b327-9475daf6cc9e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:57.215140 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21713ea-2af1-4fc2-b327-9475daf6cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:57.235399 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e21713ea-2af1-4fc2-b327-9475daf6cc9e None None] MFA Rules not processed for user `aecdb95f1a7f45bfb6d86e588c537cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:57.236636 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e21713ea-2af1-4fc2-b327-9475daf6cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:57.243626 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1453/2906] 10.222.0.71 () {58 vars in 958 bytes} [Mon Aug 1 15:50:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:57.478779 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:57.480389 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:57.492802 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6165aa-1a6d-4705-b366-885fcac114d3 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:57.496431 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a1f3e1faeba451488854da4236359ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:57.497042 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:57.497326 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:57.497605 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:57.499298 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:57.508873 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:57.510239 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:57.519357 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1454/2907] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:07.229571 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:07.515258 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:15.598348 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9611675-797a-45ea-b92f-41d7d811af20 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:15.598912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9611675-797a-45ea-b92f-41d7d811af20 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:15.598912 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9611675-797a-45ea-b92f-41d7d811af20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:15.621622 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b9611675-797a-45ea-b92f-41d7d811af20 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:15.622829 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b9611675-797a-45ea-b92f-41d7d811af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:15.630822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1454/2908] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:15.654468 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:15.670715 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947f3d9-dd74-4f25-a974-c67e8d265715 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:15.676248 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20737e2e-99a1-4a87-b7c1-251f0455ff10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:15.676871 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20737e2e-99a1-4a87-b7c1-251f0455ff10 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:15.677147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20737e2e-99a1-4a87-b7c1-251f0455ff10 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:15.677422 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20737e2e-99a1-4a87-b7c1-251f0455ff10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:15.685990 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20737e2e-99a1-4a87-b7c1-251f0455ff10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:15.687668 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20737e2e-99a1-4a87-b7c1-251f0455ff10 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:15.697278 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1455/2909] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:18.860529 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111719f-83d9-477d-98d0-28d3a2eb7937 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:18.861058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111719f-83d9-477d-98d0-28d3a2eb7937 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:18.861058 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111719f-83d9-477d-98d0-28d3a2eb7937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:18.881422 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0111719f-83d9-477d-98d0-28d3a2eb7937 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:18.882746 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0111719f-83d9-477d-98d0-28d3a2eb7937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:18.891526 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1455/2910] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:18.913590 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20737e2e-99a1-4a87-b7c1-251f0455ff10 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:18.925184 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20737e2e-99a1-4a87-b7c1-251f0455ff10 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:18.930692 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e5e0-2aad-4105-b3d9-f49b282c11be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:18.931296 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e5e0-2aad-4105-b3d9-f49b282c11be service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:18.931608 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e5e0-2aad-4105-b3d9-f49b282c11be service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:18.932623 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e5e0-2aad-4105-b3d9-f49b282c11be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:18.940977 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e5e0-2aad-4105-b3d9-f49b282c11be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:18.942545 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e5e0-2aad-4105-b3d9-f49b282c11be service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:18.952594 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1456/2911] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:21.946790 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81a36-cad4-4f3e-af3c-c2e93486cb17 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:21.947364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81a36-cad4-4f3e-af3c-c2e93486cb17 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:21.947364 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81a36-cad4-4f3e-af3c-c2e93486cb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:21.967105 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2eb81a36-cad4-4f3e-af3c-c2e93486cb17 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:21.968356 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2eb81a36-cad4-4f3e-af3c-c2e93486cb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:21.976614 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1456/2912] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:21.999066 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e5e0-2aad-4105-b3d9-f49b282c11be service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:22.011177 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e5e0-2aad-4105-b3d9-f49b282c11be service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:22.016708 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79fe45-7338-4501-a1f2-ea77e3fa8193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:22.017319 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79fe45-7338-4501-a1f2-ea77e3fa8193 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:22.017625 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79fe45-7338-4501-a1f2-ea77e3fa8193 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:22.017903 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79fe45-7338-4501-a1f2-ea77e3fa8193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:22.026774 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79fe45-7338-4501-a1f2-ea77e3fa8193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:22.028402 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79fe45-7338-4501-a1f2-ea77e3fa8193 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:22.037947 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1457/2913] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:25.101990 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39c60-2c79-49db-ae60-7c135071ee70 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:25.102542 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39c60-2c79-49db-ae60-7c135071ee70 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:25.102946 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39c60-2c79-49db-ae60-7c135071ee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:25.125126 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3da39c60-2c79-49db-ae60-7c135071ee70 None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:25.126337 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3da39c60-2c79-49db-ae60-7c135071ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:25.134081 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1457/2914] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:25.160169 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79fe45-7338-4501-a1f2-ea77e3fa8193 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:25.171526 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79fe45-7338-4501-a1f2-ea77e3fa8193 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:25.177149 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d8c4-2047-451a-b439-811c66e044c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:25.177771 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d8c4-2047-451a-b439-811c66e044c9 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:25.178059 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d8c4-2047-451a-b439-811c66e044c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:25.178341 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d8c4-2047-451a-b439-811c66e044c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:25.187031 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73d8c4-2047-451a-b439-811c66e044c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:25.188710 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73d8c4-2047-451a-b439-811c66e044c9 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:25.198767 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1458/2915] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:29.294236 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff9e60-77ae-4a82-8d62-128bcfc3d20a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:29.294791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff9e60-77ae-4a82-8d62-128bcfc3d20a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:29.294791 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff9e60-77ae-4a82-8d62-128bcfc3d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:29.314999 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7dff9e60-77ae-4a82-8d62-128bcfc3d20a None None] MFA Rules not processed for user `4dac00d0ca0d4081a88ccba053ac2218`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:29.316264 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7dff9e60-77ae-4a82-8d62-128bcfc3d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:29.325189 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1458/2916] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 1 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:29.349725 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d8c4-2047-451a-b439-811c66e044c9 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:29.361332 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d8c4-2047-451a-b439-811c66e044c9 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:29.366848 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484ed78-969c-48da-a508-309e703dca95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aa7374d435f497d9e9bdd3c5d9d2c7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:29.367510 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484ed78-969c-48da-a508-309e703dca95 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:29.367797 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484ed78-969c-48da-a508-309e703dca95 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:29.368075 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484ed78-969c-48da-a508-309e703dca95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:29.377405 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484ed78-969c-48da-a508-309e703dca95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:29.379029 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484ed78-969c-48da-a508-309e703dca95 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:29.389423 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1459/2917] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:31.055197 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff9e60-77ae-4a82-8d62-128bcfc3d20a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:31.057402 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7dff9e60-77ae-4a82-8d62-128bcfc3d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:31.144455 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff9e60-77ae-4a82-8d62-128bcfc3d20a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:31.152828 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:31.153544 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:31.153819 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:31.154175 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:31.156095 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:31.169071 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:31.170677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:31.186277 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1459/2918] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:39.384512 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=30 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:41.180263 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=47 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:00.739170 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484ed78-969c-48da-a508-309e703dca95 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:00.754146 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484ed78-969c-48da-a508-309e703dca95 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:00.759153 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:00.759803 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:00.760092 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:00.760374 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:00.762147 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:00.776148 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:00.778346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:00.791310 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1460/2919] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:52:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:00.804832 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:00.817910 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bea66-2f87-49bc-8615-41d063862bee service placement] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:00.822850 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:00.823484 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:00.823769 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:00.824047 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] PATH_INFO: `/v3/users/aecdb95f1a7f45bfb6d86e588c537cdb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:00.825807 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecdb95f1a7f45bfb6d86e588c537cdb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:00.827761 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:00.880355 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecdb95f1a7f45bfb6d86e588c537cdb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:00.890053 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecdb95f1a7f45bfb6d86e588c537cdb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:00.897339 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecdb95f1a7f45bfb6d86e588c537cdb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:00.898001 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecdb95f1a7f45bfb6d86e588c537cdb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:00.910135 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecdb95f1a7f45bfb6d86e588c537cdb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:00.916198 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1460/2920] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Aug 1 15:52:00 2022] DELETE /identity/v3/users/aecdb95f1a7f45bfb6d86e588c537cdb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:52:01.098893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:01.115427 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0160f3-c45e-4216-809f-1121e087628b service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:01.185580 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dac00d0ca0d4081a88ccba053ac2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffae11e17dfb4f79b4af936d03276821', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:01.186286 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:01.186577 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:01.186854 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] PATH_INFO: `/v3/projects/143e4e42565440ec94d82789f9f2d6db` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:01.188346 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143e4e42565440ec94d82789f9f2d6db)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:01.190449 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:01.240083 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143e4e42565440ec94d82789f9f2d6db', 'request_id': 'req-58d43c05-157d-41b8-8f5a-b7bd2826ed96'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:01.247080 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143e4e42565440ec94d82789f9f2d6db', 'request_id': 'req-58d43c05-157d-41b8-8f5a-b7bd2826ed96'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:01.253007 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143e4e42565440ec94d82789f9f2d6db', 'request_id': 'req-58d43c05-157d-41b8-8f5a-b7bd2826ed96'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:01.265991 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] The token cache is being invalidate because project 143e4e42565440ec94d82789f9f2d6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:52:01.266279 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:01.266893 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-58d43c05-157d-41b8-8f5a-b7bd2826ed96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:01.268458 dv-cinder-847536-3-smb devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1461/2921] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Aug 1 15:52:01 2022] DELETE /identity/v3/projects/143e4e42565440ec94d82789f9f2d6db => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:52:10.913052 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:11.262523 dv-cinder-847536-3-smb devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:33.629669 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:33.631146 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:33.797072 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6b59-90e1-476e-86cc-5db46c0bd4bd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:33.860968 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645733bf-4c06-41a8-beb7-6fe9d48345e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9365ba08205148e08c3a4f20d67125a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc2830c7535e40c3a0c47b50d9d8fa89', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:33.861539 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645733bf-4c06-41a8-beb7-6fe9d48345e8 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:33.861822 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645733bf-4c06-41a8-beb7-6fe9d48345e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:33.862097 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645733bf-4c06-41a8-beb7-6fe9d48345e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:33.864630 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-645733bf-4c06-41a8-beb7-6fe9d48345e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:33.881357 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645733bf-4c06-41a8-beb7-6fe9d48345e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:33.882981 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645733bf-4c06-41a8-beb7-6fe9d48345e8 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:33.893677 dv-cinder-847536-3-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1461/2922] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:43.889044 dv-cinder-847536-3-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}